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PREFACE 


The  Synthetic  Vision  Technology  Demonstration  Program  was  somewhat  unique  when 
organized  in  1988  in  that  it  was  undertaken  as  a  joint  effcxt  between  several  government  agencies 
and  many  different  organizations  within  the  aviation  industry.  While  the  participating 
government  agencies  provided  the  monies  that  actually  changed  hands,  and  many  of  the 
engineering  support  activities  were  defined  through  contractual  arrangements  between  the 
participating  parties,  nugor  contributions  were  made  by  the  sensm*  manu&cturers  and  by  the  U.S. 
Air  Fence  in  the  form  of  equipment,  hardware  and  software  develofanent,  and  technical  suppent 
The  Program  clearly  enjoyed  the  interest  and  support  of  many  organizations  widiin  the  aviatitm 
community. 

This  final  report  of  the  Technology  Demonstration  Program  is  but  one  of  many  forms  of 
conununication  used  to  document  the  lessons  learned  and  conclusions  reached  in  the  course  of 
the  four  year  effort  A  number  of  pfq)ers  were  written  and  presented  by  participants  during  the 
Program  in  many  technical  forums  throughout  the  industry.  Those  written  by  the  sensor 
manufacturers  describing  their  respective  designs  are  of  particular  interest  The  proceedings  of 
the  eight  technical  synqx)siutns  hosted  by  the  program  participants  in  support  of  the  voluntary 
^ndietic  vision  ^sterns  certification  issues  study  effect  are  also  a  valuable  source  of  infonnatkm 
regarding  all  aspects  of  the  Synthetic  Vision  concept  and  its  implementation.  The  digital  and 
video  data  collected  in  the  course  of  this  Technology  Demonstration  Program  is  to  be  archived  in 
a  form  and  format  providing  easy  access  for  those  interested  in  further  analyses  of  the  data. 
There  is  also  an  extensive  Program  documentation  file  that  may  be  of  interest  to  some.  Requests 
fw  the  archived  data  should  be  directed  to  the  manager  of  the  FAA  System  Technology  Diviskm, 
FAA/  ARD-100,  at  the  FAA  Headquarters  in  Washington,  D.C. 

This  final  rqx)Tt  is  a  conq)ilation  of  infixmadon  povided  by  the  many  participants  in  die 
Technology  Demonstration.  Volume  1  of  this  four  volume  report  is  an  Executive  Summary 
containing  an  overview  of  the  work  from  a  management  perspective.  Volume  2,  which 
documents  the  Senstx  Tower  Tests  performed  in  the  Program,  is  largely  the  work  of  Georgia 
Tech  Research  Institute  who  was  enlisted  to  provide  an  independent  assessment  of  the 
performance  of  the  sensOTS.  Volumes  documents  the  Flight  Tests  performed  in  the  program, 
incorporating  reports  from  all  of  the  participants  including  TRW,  Georgia  Tech  Research 
Institute,  the  snisor  and  di^lay  manufacturers,  the  technical  consultants  to  the  program,  and  the 
Program  Office.  Volume  4  is  a  conqnlation  of  appendixes  containing  additional  detail  potaining 
to  the  Flight  Tests. 

In  the  interest  of  keeping  the  list  manageable,  the  names  included  as  the  authors  on  the 
title  pages  of  this  final  report  of  the  Synthetic  Vision  Technology  Demonstration  are  those  of  the 
piincqial  contributes  to  the  writing  of  die  report  A  few  of  the  i»incipal  participants  in  the  wek 
performed  have  also  been  recognized  briefly  in  the  front  of  each  volume  of  the  report.  There 
were,  however,  some  75  individuals  whose  expertise,  interest  and  dedication  were  rfesolutely 


essential  to  the  success  of  this  Demonstration.  Each  individual's  contributions  were  unique; 
without  them  the  Demonstration  could  not  have  been  accon^lished. 
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1.  INTRODUCTION 


1.1  BACKGROUND 

In  1988  the  Federal  Aviation  Administration  (FAA),  in  cooperation  with  industry,  the 
United  States  Air  Face  (USAF),  die  Navy,  and  several  odier  govenunent  oiganizatkms  initiated 
an  effort  to  demonstrate  the  capabilities  of  existing  technologies  to  provide  an  image  of  the 
runway  and  surrounding  environment  for  pilots  operating  aircraft  in  low  visibility  conditions. 
This  effort  was  named  the  Synthetic  Vision  Technology  Demonstration  (SVTD)  program.  Its 
goal  was  to  document  and  demonstrate  aircraft  sensor  and  system  performance  achieved  with 
pilots  using  millimeter  wave  (MMW)  radar  sensors,  a  forward-looking  infrared  (FLIR)  sensor, 
and  a  head-up  display  (HUD). 

There  are  several  "windows"  in  the  electromagnetic  frequency  spectmm  where  molecular 
absorptioi  due  to  water  vapor  and  other  gases  is  lowest  One  such  region  is  the  visible  poitioi  of 
the  spectrum  which  we  know  from  our  visual  experience.  Other  minimum  absorption  regions 
occur  in  the  infrared  and  MMW  regions.  When  the  effects  of  water  drops  are  added,  such  as  rain 
and  fog,  then  the  higher  frequency-short  wavelength  portions  of  the  spectrum  are  much  less 
useful.  Two  frequencies  in  the  MMW  potion  of  the  spectrum  -  35  and  94  GHz  -  ^^)ear  to  offer 
significant  promise  for  the  synthetic  vision  rqiplicatitm  and  thus  radar  sensors  operating  at  these 
frequencies  were  investigated  under  the  program.  A  platinum  silicide  3-5  micron  infrared 
camera  was  also  investigated. 

The  Synthetic  Vision  System  concept  offers  the  potential  for  safer,  nxxe  widely  available 
and  cost-effective  instrument  approaches  in  low  ceiling/visibility  conditions.  Autoland  systems 
providing  landing  guidance  in  Categoy  IQ  conditions  are  very  expensive  to  {vocure,  operate  and 
maintain  because  of  the  stringent  requirements  for  reliability  and  redundancy.  Ground 
equipment  and  support  for  Type  3 ILS  (Instrument  Landing  System)  airports  is  so  expensive  that 
only  a  few  United  States  airpots  are  so  equipped.  In  using  the  autoland  systems,  the  pilot  must 
scan  the  instrument  panel  with  only  the  ILS  guidance  indicatiois  available  to  moiitor  course  and 
glideslope  progress.  Synthetic  Vision  would  provide  the  aircrew  a  redundant  and  independent 
source  of  data  to  mcMiitor  progress  during  an  instrummt  guided  ^proadL  InthevastmajoriQrof 
low  visibility  operations  today,  the  aircrew  fly  the  approach  to  a  minimum  altitude  consistent 
with  the  capabilities  of  the  instrument  landing  system  on  the  ground  and  with  their  level  of 
equipment  and  training  in  the  coclpit  at  which  point  they  must  then  bring  the  outside  references 
as  well  as  the  information  or  their  instrument  panel  into  view  and  accomplish  a  manual  landing. 
The  pilot  must  transition  from  the  instrument  panel  scan  alone  to  the  outside  view  very  late  m  the 
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approach,  with  seconds  to  touchdown,  and  during  a  high  workload  phase  of  flight.  This 
transition  firom  "head  down"  to  "head  up"  would  be  avoided  if  the  pilot  could  already  "see"  the 
runway  and  flight  data  on  a  headup  display  throughout  the  approach,  in  spite  of  fog  and 
precipitation. 

The  c(»icq)t  of  using  millimeter-wave  senscos  fw  low  visibility  aircraft  (^)erations  is  not 
new.  In  the  late  1960's,  an  imaging  33  GHz  radar  designed  by  Texas  Instruments  was  flight 
tested  on  a  Convair  240  aircraft  with  the  image  generated  on  a  head-down  cathode  ray  tube 
display.  The  weather  penetration  capability  of  the  radar  was  demonstrated  in  fog,  snow,  and 
light  rain.  Swissair  conducted  flight  tests  with  a  different  configuration  of  the  TI  system  in  the 
early  1970's.  It  was  later  installed  by  the  Air  Force  Flight  Dynamics  Directorate  on  a  C-13S 
aircraft  with  a  five  foot  antenna  for  flight  evaluation.  The  Air  Force  flew  1,619  ^^proaches  in  a 
wide  variety  of  weather-conditions,  including  heavy  snow  and  heavy  rain,  fiirtl^  validating  die 
weather  penetration  capability  of  the  millimeter-wave  radar. 

In  the  early  198(ys,  Federal  Express  Corporation  pioneered  the  development  of  the  HUD 
as  the  display  device  to.  be  used  with  an  imaging,  weather  penetrating  sensor.  Considerable 
effort  and  investment  led  to  the  certification  of  a  HUD  for  commercial  aviation  use.  However, 
the  risk  and  estimated  additional  cost  of  further  develt^ment,  to  include  a  weather  penetrating 
sensor,  and  to  achieve  certification  was  so  high  that  Federal  Express  chose  not  to  continue. 

A  significant  subset  of  the  Synthetic  Vision  concept  has  already  been  certified  for 
commercial  use.  Today,  Alaska  Airlines  is  flying  manual  Category  3a  approaches  to  l^pe  2  and 
3  airports  with  a  SO  foot  decision  height  and  700  RVR  (Runway  Visual  Range),  via  a 
combination  of  an  inertiaily  based  Flight  Dynamics  Inc.  head-up  guidance  system  (HGS),  and 
ILS  equipment  The  system  does  not  include  a  weather  penetrating  sensor,  but  does  allow  the 
pilot  to  maintain  an  outside  scan,  and  greatly  enhances  the  precision  of  manually  flown 
approaches. 

While  these  previous  efforts  to  develop  and  flight  test  millimeter-wave  sensors  strongly 
suggest  that  a  low-visibility  imaging  landing  system  is  feasible,  insufficient  engineering  data 
needed  to  predict  system  performance  and  support  the  design  of  an  operational  installation  was 
produced. 

IJ.  OBJECTIVE 

The  objective  of  the  Synthetic  Vision  Technology  Demonstration  program  was  to 
develop,  demonstrate,  and  document  the  performance  of  a  low-visibility,  visual-imaging  aircraft 
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landing  system.  The  experimental  Synthetic  Vision  System  continents  included  on-boaid 
imaging  senscH*  systems  using  millimeter-wave  and  infrared  technology  to  penetrate  fog,  and 
both  head-up  (HUD)  and  head-down  (HDD).displays.  The  displays  presented  the  processed 
raster  image  of  the  forward  scene,  combined  with  suitable  avionics-based  stroke  symbology  for 
the  pilot's  use  during  a  manually  flown  approach  and  landing.  The  experimental  system, 
sonoetimes  referred  to  as  a  functitmal  prototype  system,  included  all  the  functions  (in  prcXoQrpe 
form  (Xily)  required  to  accotx^)lish  precision,  non-precision,  and  nonin^rument  qrproaches  and 
landings  in  low  visibility  weather  conditions. 

An  important  part  of  this  program  was  to  identify  and  document  issues  concerning 
(^rational  procedures,  safi^,  perftxmance  requirements,  and  airspace  system  ctniqratibiliQr.  To 
satisfy  the  objective,  it  was  necessary  to  provide  test  data,  flight  demonstration,  and  study  of 
certification  issues  such  that  aircraft  operators,  manufacturers,  and  government  regulators  could 
objectively  see  the  capabilities  of  current  technologies  to  understand  its  costs,  benefits  and  risks. 


IJ  TECHNICAL  APPROACH 

A  preliminary  technology  survey  was  performed  with  the  assistance  of  experts  in  the 
technologies  of  imaging  sensors,  image  processing  and  cockpit  displays.  The  survey  confirmed 
the  notion  that  the  Synthetic  Vision  system  concept  is  feasible.  The  survey  also  highlighted  the 
numerous  challenging  technology  and  systems  issues  to  be  resolved.  It  was  clear  that 
insufficient  engineering  data  existed  as  a  basis  for  accurate  performance  predictions  and  for 
establishing  system  performance  requirements.  It  was  also  clear  that  suitable  imaging  sens(»s 
did  not  exist  in  a  form  suitable  for  this  flight  demonstration,  even  though  the  state  of  the  art  of 
senso*  technology  ^rpeared  sufficiently  advanced.  Therefrxe,  before  a  technology  demcmstratimi 
could  be  performed,  one  or  more  such  sensors  had  to  be  developed. 

While  the  predicted  capability  of  infrared  sensors  to  image  airport  scenes  in  fog  and 
precipitation  conditions  was  not  promising,  actual  performance  data  for  this  scenario  was  not 
available,  and  infrared  sensor  technology  could  not  be  discounted.  Since  the  use  and 
development  of  infrared  systems  for  imaging  has  been  through  several  generations,  it  was 
decided  that  the  project  would  need  only  to  seek  a  suitable  infrared  senstx:,  radier  dian  develop  a 
new  one.  The  limited  resources  available  for  sensor  development  were  to  be  applied  to  the 
development  of  suitable  MMW  sensors. 

In  early  1988,  a  proof-of-concept  demonstration  was  arranged  by  the  Air  Force  Wright 
Laboratory  for  FAA  and  other  government  officials.  It  was  conducted  on  the  Lockt^ed  C-130 
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High  Technology  Test  Bed,  equif^ied  with  a  modified  Flight  Dynamics  Inc.  raster/stndoe  capable 
HUD  and  a  Honeywell  forward-loddng  infrared  sens(V.  This  demonstration  helped  the  i»oject 
team  visualize  the  essential  elements  of  an  integr^ed  demonstration  systent  It  also  helped  to 
convince  decision  makers  that  a  Synthetic  Vision  Technolt^  DemtHistratitxi  was  a  wcxthwhile 
venture  and  led  to  commitments  for  most  of  the  project  funding. 

Erqreiimental  system  performance  requirements  woe  identified  and  used  as  the  basis  for 
the  selection,  acquisition  and  integration  of  comp(»ent  systems.  It  was  decided  to  conduct  the 
flight  {Hogram  on  a  typical  transport  category  aircraft  and,  to  further  establish  the  capabilities  of 
the  sensor  technologies  as  well  as  satisfy  the  needs  of  program  participants,  an  executive  class 
aircraft  was  selected. 

Sensors  were  to  be  developed  via  a  competitive  procurement  in  which  a  major 
requirement  was  that  senstxs  be  provided  within  one  year  for  tower  testing  and,  if  found  suitable, 
be  supported  for  subsequent  flight  testing  and  demonstration.  A  major  objective  of  the 
procurement  was  to  explore  the  apabilides  of  the  varieQr  of  sensor  frequencies  and  technologies 
that  were  available. 

Tower  testing  of  the  sensors  was  carried  out  with  the  support  of  the  manufactures  under 
the  auspices  of  Georgia  Tech  Research  Institute  (GTRI),an  independent  and  technically 
competent  organization,  in  existing  USAF  avionics  test  facilities.  The  tower  tests  were 
conducted  to  document  the  performance  of  the  sensors  in  measured  weather  conditions,  to 
characterize  the  phenomenology  of  sensor  wavelengths,  scene  materials  and  atmospheric 
conditions,  and  to  assess  sensor  suitability  for  flight  testing. 

Sensors  having  the  requisite  poformance  c^jabilities  were  then  integrated  with  the  image 
processing,  displays,  aircraft  instrumentation,  weather  instrumentation,  and  data  acquisition 
equipment  to  fxoduce  the  expoimental  Synthetic  Vision  system  necessary  for  flight  testing  and 
demonstration.  The  functionalities  were  provided  to  explore  the  wide  variety  of  operational 
applications  of  the  Synthetic  Vision  concept  envisioned  by  the  aviation  community,  including 
precision,  non-precision  and  autonomous  approach  and  landing  operations. 

It  was  recognized  that  civil  implementation  of  Synthetic  Vision  would  require 
certification,  and  that  the  risks,  costs  and  methodologies  of  achieving  successful  certification  are 
major  uncertainties.  A  study  was  undertaken  of  operational,  technical  and  certificaticm  issues  to 
[xovide  regulators  and  potential  applicants  a  clear  understanding  of  the  ceitiflcation  pztxress,  and 
to  identify  difficult  issues  that  might  complicate  or  prevent  certification.  This  study  was 
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OTganized  as  a  voluntary  community  activity  with  extensive  participation  by  all  parts  of  the 
aviation  community  including  the  FAA  certification  organizations. 

1.4  SCOPE 

The  diversity  in  technologies  which  comprise  the  Synthetic  Vision  concept  (millimeter- 
wave  sensors,  IR  sensors,  head-up  displays,  human  factors,  image  processing  and  systems 
integration)  required  the  scope  to  be  carefully  constrained  so  as  to  be  able  to  conduct  a 
meaningful  technology  demonstration  within  the  program's  finite  time  and  financial  resources. 
The  experimental  system  was  limited,  therefore,  to  the  incorporation  in  a  fixed  wing  aircraft  of 
existing  display  technology,  millimeter-wave  and  infiared  sensors;  and  sufficient  instrumentation 
to  permit  documentation  of  the  weather,  sensor  system  perfcxmance.  and  pilot  performance.  The 
scope  was  further  limited  to  a  set  of  experiments  and  demonstrations  that  could  be  set  up  and 
accomplished  in  approximately  one  year .  Millimeter-wave  sensors  were  developed  only  to  the 
extent  possible  in  one  year.  Information  fusion  was  pursued  only  to  the  extent  necessary  to 
achieve  the  simultaneous  display  of  stroke  symbology  widi  raster  imagery  on  the  HUD.  Existing 
techniques  for  image  enhancement  were  applied  only  as  necessary  to  sharpen  the  image  of  the 
runway  complex. 

A  related  2q)plication  of  weather  penetrating  sensor  technology,  the  detection  of  vessels 
whose  masts  pen^rate  the  obstruction  clearance  plane  of  the  ILS  approsteh  to  Boston's  Logan 
International  Airport,  was  undertaken  for  the  FAA  New  England  Region  (the  New  England 
Region  jxovided  the  additional  funding  required).  The  Program  Office  evaluated  the  capability 
of  the  MMW  sensor  technology  for  this  use,  developed  system  requirements  and  estimated 
acquisition  costs  for  the  Regional  Office. 
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2.  PROGRAM  MANAGEMENT  OVERVIEW 


2.1.  MANAGEMENT  APPROACH 

The  Technology  Survey  revealed  engiiwering  challenges  requiring  a  diverse  omtribution 
of  expertise,  facilities  and  financial  resources  that  only  a  joint  team  of  government  agencies  and 
industry  could  provide.  This  team  was  led  by  the  Federal  Aviation  Administration  and 
assembled  over  the  course  of  the  jxogram.  A  diagram  of  the  project  management  team  is  found 
inHgure  1. 

2.1.1.  Federal  Aviation  Administration 

The  FAA  initiated  this  project  at  the  direction  of  the  Administrator,  Mr.  T.  Allan 
McAitor.  It  was  managed  within  the  FAA  Research  and  Development  Service  under  the 
Associate  Administrator  for  Development  and  System  Engineering.  Inter-agency  agreements 
with  the  Air  Force,  National  Oceanic  And  Atmospheric  Administration  (NOAA),  and  National 
Aeronautics  and  Space  Administration  (NASA)  woe  used  extensively  for  this  project  The  FAA 
transfated  the  majority  of  die  project  funds  to  the  Air  Frace,  but  also  transfimed  funds  to  NOAA 
fca  a  grant  to  the  Maryland  Advanced  Developmmt  Laboratory  and  to  NASA  for  administrative 
and  technical  support  and  official  travel. 

2.1.2.  Spedalized  Technical  Experts 

Throughout  the  course  of  the  project,  the  advice  of  specialized  technical  experts  was 
sought  to  understand  technical  system  requirements,  to  provide  independent  assessments  during 
the  progress  of  sensor  developments,  and  to  maintain  the  validity  of  the  experiments  and  data 
analyses. 

Dr.  Robert  D.  Hayes  of  RDH  Incorporated,  an  expert  in  millimeter  wave  sensor 
performance,  assessed  the  available  technology  in  weather  penetrating  sensors,  contributed  to  die 
development  of  prototype  sensor  requirements,  advised  the  management  team  during  design 
reviews,  developed  theoretical  predictions  of  sensor  performance  in  weather,  and  advised  the 
d^tfl  analysis  teams.  Dr.  Hayes  also  defined  the  system  requirements  for  the  proposed  Harbw 
Vessel  Detection  System  at  Boston's  Logan  International  Airport. 

Mr.  Paul  Mongers  of  PAULTEK  Incorporated,  designer  and  inventor  of  electro-optical 
and  image-processing  systems,  assessed  the  state  of  the  art  of  real  time  image  enhancement 
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Synthetic  Vision  Project  Office  *  Hampton,  VA 

Project  Manager  -  M.  Burgess/FAA  >  ARD 
Deputy  Project  Manager  -  Lt  Col  D.  Dunford/USAF 
Project  Engineer  -  Dr.  J.  A.  Zak/Hughes  STX 


Figure  1.  Synthetic  Vision  Program  Management  Team 
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test  program,  and  designed  and  built  an  optical  system  for  through-the-HUD  inflight  video 
recordings. 

Dr.  J.  Allen  Zak  of  Hughes/STX,  a  meteorologist,  provided  essential  expertise  regarding 
atmospheric  conditions  encountered  during  aircraft  operations  and  the  sources  and  types  of 
instrumentation  requited  to  measure  those  ctxiditions.  Ife  participated  in  the  development  of  the 
Synthetic  Visitm  tower  test  plan  and  die  plans  for  atnxr^heric  data  coUection  at  tiie  tower  and  in 
the  aircraft,  and  performed  teductimi  and  quality  control  of  the  data  collected  during  the  flight 
tests.  Dr.  Zak  coordinated  the  teal  time  natitxrwide  weather  forecasting  that  led  to  successful 
encounters  with  the  special  cases  of  low  visibility,  rain  and  snow  conditions.  Dr.  Zak  served 
throughout  tire  program  as  a  member  of  the  Program  QfiBce,  participating  in  program  planning, 
schedule  and  resource  tracking,  coordinating  the  support  activities  of  the  technical  experts,  and 
progress  reporting.  He  was  responsible  for  the  coordination  of  the  Harbor  Vessel  Detection 
Requirements  Study. 

2.13.  UJS.  Air  Force 

The  United  States  Air  Force  Wright  Laboratory,  Flight  Dynamics  Ditectorate,  Wri^t- 
Patterson  AFB,  OH,  was  the  lead  Air  Force  organization.  In  1988  the  Autonomous  Landing 
Guidance  (ALG)  Project,  managed  by  the  Flight  Controls  Division,  was  investigating  concerts 
using  infrared  and  millimeter-wave  imaging  sensors  to  produce  images  on  head-up  di^lays  in 
conjunction  with  other  symbology  on  the  HUD;  concepts  which  were  comrrxxi  to  the  Synthetic 
Visitxi  System  amcqx.  The  FAA  and  Air  Force  agreed  to  collaborate  in  a  joint  Syntiietic  Visicm 
Technology  Demonstraticm  Project  to  ctq)italize  on  the  existing  efforts  and  research  capabilities 
at  Wright  Labcxatory.  The  Wright  Labtxatory  also  assigned  personnel  to  full  time  posititms  as 
the  Deputy  Program  Manager,  resident  in  the  Synthetic  Vision  Program  Office,  and  as  the 
Tower  Test  Director,  resident  at  Wright  Patterson  AFB. 

Wright  Laboratory  possessed  technical  expotise,  ragineeiing  research  and  test  facilities, 
and  contracting  durabilities  that  were  particularly  well  suited  for  tiris  piojed.  Of  early  benefit  to 
the  project  was  tire  Lockheed  C-130  High  Technology  Test  Bed,  made  available  by  the  Air  Fmce 
via  the  ALG  pogram,  for  a  proof-of-concept  demonstration.  The  Air  Fence  Materiel  Command 
at  Wright  Patterson  AFB  also  made  available  the  Program  Research  and  Development 
Announcement  (PRDA)  contracting  method  that  can  shorten  competitive  procurement  time  and 
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vm  used  for  the  sensor  devd(^)a)ent  task.  Finally.the  Air  Fbice  Avionics  DiiecUxate  provided 
a  unique  tower  fadlily  for  avionics  testing  which  overlooks  an  unused  but  in^mmoited  runvray 
cooqdex,  that  was  ideal  few  the  perfonnaiKX  testing  of  promising  Synthetic  Vision  sensors.  The 
Flight  Control  Division  accepted  primary  responsibility  for  the  sensor  development  and  senstv 
performance  tower  tests. 

The  Directorate  of  Materiel  Management,  Sacramento  Air  Lx)gistics  Center  (SM-ALQ 
McClellan  AFB,  CA,  another  Air  Force  Materiel  Command  organization,  manages  the 
Microelectronic  Technology  Support  Program  (MTSP)  on  behalf  of  the  Air  Force  and  (Xher 
government  agencies.  A  key  element  of  MTSP  is  a  set  of  competitively  awarded  crmtracts  that 
are  uniquely  and  flexibly  designed  to  assist  government  agencies  with  microelectronics  and 
advanced  technology  projects.  On  behalf  of  the  Synthetic  Vision  Program,  the  MTSP  Program 
provided  and  ovosaw  contracts  fm*  an  additional  sensTV  development  and  testing  task,  and  fx 
the  system  integration,  flight  demonstration  and  documentation  of  the  experimental  Synthetic 
Vision  System. 

2.1A  UJS.Navy 

The  Cartier  Operations  Directorate  (OPSS)  and  NAVAIR  were  Ae  {oiinary  participating 
Navy  organizations.  The  Navy  is  pursuing  technologies  that  improve  carrier  approach  and 
landing  durabilities  at  night  and  in  low  visibilities.  The  Signanne  Managed  Air  TrafBcCootnd, 
Af^noach  and  Landing  System  (SMATCALS)  program  under  the  sponsorship  of  OP-55  is  an 
umbrella  program  for  the  development  of  a  vatiely  of  shqrboatd  and  airborne  systems  in  support 
of  carrier  air  traffic  control  and  landing  tasks.  TIm  Navy  interest  centered  on  the  potential 
suitability  of  SynUietic  Vision  fd*  use  by  die  pilot  to  nxinitd  qjproaches  conducted  by  automatic 
carrier  landing  systems.  The  Navy  SMATCALS  program  provided  fimding  to  the  Program  in 
1990  for  the  sensor  develqmient  effort  Personnel  from  the  Naval  Air  War&re  Center,  Patuxmt 
Naval  Air  Station,  MD,  participated  in  sensor  design  technical  meetings,  Certifleadon  Issues 
Study  Team  meetings,  and  in-flight  demonstrations  of  the  experimental  system. 

2.1.5.  Maryland  Advanced  Developinent  Laboratory 

The  Maryland  Advanced  Development  Laboratory  (MADL)  of  Greenbelt  Md,  is  a  nmi- 
profit  affUiate  of  the  University  of  M^land.  MADL  participation  was  funded  by  the  project 
through  a  NOAA  grant  and  an  inter-agency  agreement  between  NOAA  and  the  FAA,  and 
included  initial  planning  tasks,  assessment  of  current  technology,  planning  for  simulation  tasks, 
definition  of  projected  performance  requirements,  and  fixmatimi  of  the  Certificatirm  Issues  Stu^ 
Team. 
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2.1.6.  Partkipatiiig  Industry  Organizatioiis 

This  technology  (temonstration  project  was  dependent  on  the  knowledge,  expoience, 
resources,  and  engineering  c^[)abilities  of  private  industry.  Numerous  firms  voluntarily 
contributed  time,  engineering  talent,  and  equipment  to  this  effort  for  little  or  no  compensatioo. 
Major  govemmnit  contracts  were  also  required  to  prepare  for  and  oxnidete  the  demonstration. 

The  scope  of  these  contracts  and  the  participating  industry  organizations  are  identified  below. 

In  April  1989,  an  Air  Force  Program  Researdi  and  Developmmt  Armounconent  Q’RDA) 
was  published  by  Wright  Laboratory  in  the  Commerce  Business  Daily  inviting  bids  to  design, 
develop,  tower  test  and  flight  test  an  imaging  weather  penetrating  sensw.  Ten  proposals  wm 
sutoitted,  and  TRW,  Lear  Astronics,  Martin  Martota,  and  Eastman  Kodak  were  awarded  Phase 
1  contracts  to  provide  sensOT  designs.  After  the  sensor  design  presentations,  die  project  selected 
Lear  Astronics  to  build  and  test  their  94  GHz  frequency  Modulated  Qmtinuous  Wave  ^’MCW) 
radar.  Meanwhile,  Wright  Labrxatory ,  <xi  behalf  on  an  Air  Fnce  project,  awarded  contracts  to 
Kodak  and  TRW  for  development  of  their  designs. 

The  design  of  a  94  GHz  radar,  by  Lear  Astronics  Corporation  of  Santa  Mcmica,  CA, 
was  quite  irmovative,  offering  the  potential  of  impressive  performance  with  moderate 
development  risk.  Designed  specifically  for  the  Synthetic  Vision  Technology  Denxmstration,  it 
was  selected  as  dre  piimaiy  and  most  prcxnising  candidate  for  npeiimental  prototype  int^iatioa 
and  flight  test  However,  successful  and  timely  completion  of  the  tower  tests  and  suitability 
flight  tests  was  a  prerequisite  to  full  scale  flight  resting. 

The  risk  of  depending  on  a  single  sensor  development  for  the  flight  demonstration  and 
the  need  for  characterization  of  33  GHz  sensor  p^ormance  led  to  a  contract  with  Ehm^wdl 
Systems  Researdi  Center  of  Bloomington,  MN,  for  design  and  fabrication  of  a  sensor  at  that 
fiequency.  Honeywell  had  previously  manufactured  3S  GHz  radars  for  another  Air  Force 
applicadcm  diat,  with  the  addition  of  a  suitable  antenna  and  an  upgraded  signal  processor,  could 
be  used  for  tower  testing  and  perhaps  flight  testing.  On  behalf  of  the  project,  the  Air  Force 
Sacramrato  Air  Logistics  Center,  Microelectronics  Technology  Sujqxirt  Program,  awarded  die 
contract  to  Honeywell  in  June  1991.  It  was  modified  in  December  1991  to  upgrade  the  radar  to  a 
flight  w(xthy  configuration  and  to  jnovide  flight  test  support  when  it  became  clear  it  would  be 
needed  as  the  primary  rest  sensor. 
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Wright  Labcwatoiy  offered  modest  contracts  to  other  sensor  manufacturers  to  bring 
existing  sensors  to  the  tower  for  Synthetic  Vision  performance  testing.  One  such  contract  was 
awarded  in  October  1991  to  ITTCVNorden  Systems  of  Norwalk,  CT,  to  test  their  95  GHz 
TALONS  radar  system.  The  tests  were  conducted  successfully  from  October  1991  through 
February  1992.  The  Program  also  tested  in  tte  tower  facility  the  3-5  micron  FUR  camera 
designed  in  the  design  competition  phase  and  built  for  the  Air  Force  by  Eastman  Kodak  of 
Rochester,  NY.  Kodak  also  (xovided  and  suppcffted  another  version  of  the  same  design  in  the 
flight  test  phase  of  the  Program  through  an  arrangement  with  TRW. 

Georgia  Technology  Research  Institute  (GTRI)  of  Marietta,  GA,  was  awarded 
>  contractsby  Wright  Labcxatoiy  and  TRW  to  indqxadently  analyze  sensor  performance  data  in 
the  Tower  Test  and  Flight  Test  phases  of  the  Program.  Under  the  first  contract,  awarded  by 
Wright  Laboratory  in  April  1991  for  the  tower  tests,  GTRI  wrote  portions  of  the  test  plan, 
developed  data  collection  and  reduction  software,  calibrated  each  sensor,  and  con^leted  the 
sensor  performance  analysis.  TRW  also  awarded  a  subcontract  to  GTRI  in  August  1991  fix' 
support  of  the  flight  test  task. 

The  Air  F<xoe  Microekctronic  Technology  Support  Program  issued  a  delivery  ordca-  to 
TRW  Military  Electronics  and  Avionics  Divirion  (MEAD),  of  San  Diego,  CA,  to  serve  as  the 
prime  contractor  for  the  System  Integration,  Evaluation  and  Dononstration  (SEID)  task  of  the 
Technology  Demcnstration.  The  division  of  responsibilities  between  TRW  and  die  participating 
organizations  is  illustrated  in  Figure  2. 
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Figure  2.  Experimental  System  Int^ration  and  Flight  Test  Team 
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An  important  element  of  the  cooperative  management  approach  for  the  System 
Integration,  Evaluation  and  Demonstration  (SIED)  task,  agreed  to  between  TRW,  the  MTSP 
contracting  office,  and  the  Synthetic  Vision  Program  Office,  was  the  level  of  attention  givoi  to 
the  Program  Plan  and  tvithin  it,  the  Resource  Allocation  Wan.  The  Program  plan  was  developed 
as  an  expansion  of  the  contract  Task  Assignrrrent  Plan  as  a  joint  effort  on  the  part  of  all  the 
participants.  The  Resource  Allocation  Plan  consisted  of  the  planned  monthly  spending  for  each 
major  line  item  in  the  Work  Breakdown  Structure,  found  in  the  Program  Plan,  over  the  life  of 
the  contract  The  Program  Office,  the  TRW  managers,  and  the  subcontract  managers  monitored 
actual  spending  with  respect  to  the  plan,  anticipated  problems,  and  woe  able  to  malm  informed 
and  timely  adjustments.  While  it  was  consutent  with  the  contractor's  monthly  financial  repotting 
system  required  by  the  govenunent,  the  Resource  Allocation  Plan  provided  mme  detail  and 
provided  the  information  in  a  mote  timely  fashion. 


Z2.  SCHEDULE 

The  schedule  for  the  Synthetic  Visitm  Tedinology  DenKmstratkm  project  is  presented  in 
Figures.  Each  of  the  schedule  elements  shown  is  briefly  discussed  below;  an  overview  of  each 
of  the  majm*  program  elements  is  provided  in  section  3  of  rhi-s  Executive  Summary. 
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2JL1.  Techiiol<^  Survey 


Eariy  activity  in  1988  provided,  in  a  preliminary  form,  program  definiticMi,  the  technical 
feasibility,  and  cost  estimates  to  complete  the  Inject  It  also  included,  through  early  Air  Force 
cooperation,  the  proof  of  concept  flights  with  the  Lockheed  C-130  High  Technology  Test  Bed. 
The  preliminary  technology  assessment  was  completed  in  January  1989. 

12J2  Estimated  Demonstration  System  Performance  Requirements 

The  definition  of  performance  requirements  for  the  demonstration  system  axnmenced  in 
early  1989  in  preparation  for  the  sensor  research  and  development  announcement  and  source 
selection.  In  1989  the  Maryland  Advanced  Devdoi»nent  Laboratory  (MADL)  began  integration 
of  a  low  cost  laboratory  test  bench  system  incrvporating  equipment  jxovided  to  the  Program  by 
industry  including  a  GEC  HUD,  an  infrared  sensor,  and  a  processor  intended  to  degrade  the 
infrared  sensor  performance  in  a  way  that  might  approximate  a  millimeter  wave  sensor’s 
performance.  The  MADL  notion  was  to  move  this  test  bed  system  into  a  lig^  aircraft  to  provide 
an  SVS  simulaticm  facili^  with  which  to  further  understand  the  technical  issues  and  to  assist  in 
establishing  the  performance  requirements  for  the  demonstration  system  to  be  constructed  by 
TRW  and  others  in  industry  for  the  SyndieticVisirmProgranL  The  MADL  task  was  terminated 
in  October  1990,  because  it  could  not  be  completed  within  the  budget  and  time  allotted. 

223.  Soisor  Development  and  Tower  Testing. 

A  pre  bidders'  conference  for  the  sensor  develq>ment  conq)etition  was  held  at  Wright- 
Patterson  Air  Force  Base  in  October  1988.  A  Program  Research  and  Development 
Announcement  was  {xiblished  in  the  Commerce  Business  Daily  in  Ai»il  1989,  the  first  crmtracts 
awarded  in  January  1990.  Four  contractors  were  selected  to  perform  sensor  design  studies, 
which  were  presented  in  late  Match  and  early  April  1990.  Lear  Astronics  Corporation  was 
awarded  a  ccmtract  to  build  and  test  a  94  GHz  sensor  system  in  June  1990  fw  delivery  in  April 
1991.  Lear  Astronics  completed  the  initial  versitm  of  the  sensor  in  August  1991,  but  it  was  not 
suitable  for  tower  testing  and  the  Lear  Astrcmics  sensor  development  contract  was  terminated  in 
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Januaiy  1992.  In  August  1992,  under  a  TRW  subcontract,  Lear  Astronics  provided  an 
version  of  the  94  GHz  sensor  for  tower  testing  to  evaluate  flight  worthiness  and  estahiisb 
baselim  performance.  It  was  found  conditionally  suitable  and  sent  to  the  aircraft  at  the  end  of 
September  1992. 


Figure  3.  Synthetic  Vision  Technology  Demonstration  Program  Schedule 
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Preliminary  sensor  tower  tests  at  the  Air  Force  Target  Characterization  Facility 
commenced  in  May  1991.  An  Air  Force  owned  35  GHz  sensor  was  first  tested  in  May  1991  to 
validate  the  test  plan  procedures,  data  acquisition  and  reduction  systems.  Tests  of  the  initial  Lear 
Astronics  94  GHz  sensor  were  performed  in  August  1991.  A  95  GHz  Norden  Systems  radar  was 
successfully  tested  firom  November  1991  through  February  1992.  An  Air  Force  Kodak  3-5 
micron  imaging  infrared  system  was  tested  from  March  through  May  1992.  The  flight 
configuration  of  the  Honeywell  35  GHz  sensor  system  was  tested  from  April  to  May  1992,  found 
conditionally  satisfactory  for  flight,  and  then  installed  on  the  flight  test  aircraft  in  June  1992. 
Reports  of  all  tower  test  results  were  provided  in  January  1993  by  the  tower  test  contractor, 
Georgia  Technology  Research  Institute. 

A  contract  was  awarded  in  June  1991  to  Honeywell,  Inc.  to  build  a  new  anteima  and 
provide  an  integrated  35  GHz  radar  system  for  tower  and  limited  flight  testing  by  October  1991. 

After  it  was  learned  that  Lear  Astronics  could  not  deliver  a  suitable  system  in  time  fw  tower  and 
flight  testing,  the  Honeywell  contract  was  modified  in  December  1991,  to  provide  a  fully 
flightworthy  system  by  February  1992.  The  HoneyweU  system  was  delivered  and  submitted  to 
hot  bench  testing  in  Felauary ,  returned  to  Honeywell  for  naodificatitms  in  March,  and  sent  to  the 
Air  Force  for  Tower  Testing  at  the  end  of  March.  Shakedown  flight  testing  began  in  mid  May. 

2,2.4.  Experimental  System  Integration,  Evaluation  and  Demonstration 

A  contract  was  awarded  in  Match  1991  to  TRW  as  the  prime  contractor  for  design  and 
integration  of  the  experimental  flight  demonstration  system  and  conduct  of  flight  test  activi^. 
Modifications  to  the  Gulfstream  n  test  aircraft  were  completed  in  December  1991,  hot  bench 
testing  in  February  1992,  and  final  integration  of  the  experimental  system  in  May  1992. 
Shakedown  flights  were  conducted  in  May  and  June.  Full  scale  flight  tests  began  in  July  1992 
with  the  35  GHz  senses:  system,  a  GEC  head-up  display  and  a  Kodak  3-5  micron  infrared  camna. 

In  October,  the  35  GHz  system  was  tenqxsarily  removed  and  the  Lear  Astronics  94  GHz  senstsr 
installed  and  flight  tested.  The  35  GHz  system  returned  in  November  and  flight  tests  continued 
until  mid  December.  The  final  report  on  this  activity  was  provided  in  February  1993. 

2.23.  Certification  Issues  Study  Team 

The  Certification  Issues  Study  Team  was  organized  in  1989,  holding  its  first  meeting  in 
March,  and  the  last  of  eight  plenary  sessions  in  January  1993.  The  draft  advisory  circular  and 
certi&ation  roadmap  were  completed  by  the  team  and  presented  at  the  sixth  meeting  in  Match 
1991. 
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12,6.  Harbor  Vessel  Detection  Systems  Requirements 

The  Harbor  Vessel  Detection  Systems  Requirements  task  began  in  mid  1990  with  a 
definition  of  the  user's  functional  req’urement  to  detect  and  locate  tall  ships  in  the  Boston 
Harbor.  A  Memorandum  of  Understanding  between  the  FAA  New  England  Region  and  FAA 
R&D  Service  was  signed  in  August  1990,  sensor  performance  tests  were  conducted  from  May 
1991  through  August  1992,  and  the  system  specificatitm  document  provided  to  the  New  England 
Region  in  January  1993. 

23.  BUDGET 

Total  funding  for  the  program  was  $14,624,000  from  the  following  sources:  $1 1.36 
million  from  the  FAA;  $3.0  million  from  other  government  agencies;  $214,000  from  the  Navy; 
and  $50,000  from  the  Air  Force.  There  were  additional  contributions  in  time  and  equipment 
from  industry,  especially  Honeywell,  Lear  Astionics,  GEC  Avionics,  Douglas  Aircraft  Company, 
Eastman  Kodak,  and  Petersen  Aviation.  The  Air  Force  also  contributed  significant  time  and 
facilities  not  reflected  in  the  above  figures.  These  funds  were  distributed  to  major  task  elements 
as  follows: 

Element  Allocation  f  $millionl 


Demonstration  System  Performance  Requirements  1.2 

Sensor  Development  3.8 

Tower  Sensor  Testing  1 .0 

System  Integration,  Evaluation  &  Demonstration  7.7 

Administration,  Travel,  Management  Support  0.9 


The  major  expense,  $7.7  million,  was  the  provision,  modification,  and  flight  of  the  G-II 
test  aircraft.  The  $3.8  million  for  sensor  development  included  the  development  and  provision  of 
the  94  GHz  millimeter  wave  sensor  system  and  the  modification,  and  provision  of  the  35  GHz 
millimeter  wave  sensor  system.  Testing  of  these  and  other  sensors  on  the  instrumented  tower 
facility  cost  about  one  million  dollars,  as  did  the  performance  requirements  activity. 
Administrative  expenses,  management  support  contract,  and  extensive  travel  for  the  pilots  and 
project  management  team  required  $900,000  over  the  course  of  the  program. 
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3.  TECHNOLOGY  DEMONSTRATION  PROGRAM  ELEMENTS 


3.1.  TECHNOLOGY  SURVEY 

A  technical  advisory  team,  assembled  for  the  project  under  a  grant  to  the  Maryland 
Advanced  Development  Laboratory  (MADL)  conducted  a  survey  of  current  Synthetic  Vision 
technology  areas  and  published  die  Preliminary  Technology  Assessment  Report  in  January  1989. 
The  objectives  of  the  survey  were  to  verify  the  feasibility  of  a  demonstration  with  current 
technology,  identify  inqxntant  technical  issues  and  estimate  system  performance  requirements. 
The  requireanents  listed  below  are  not  the  final  findings  of  this  project,  which  are  described  later 
in  this  volume  in  Section  3.4.7  (Sensor  Performance),  Section  3.4.8  (Image  (^ality).  Section 
3.4.9  (Pilot/System  Performance)  and  Section  3.4.S  (Lessons  Learned).  A  result  of  a  sixty  day 
study,  they  were  meant  to  be  used  for  (Hogram  planning;  thatis,todetBriniiie  whatnaustbedoae 
to  achieve  a  flight  demonstration,  to  develop  a  realistic  schedule,  to  estimate  costs  and  to 
establish  resource  priorities. 

3.1.1.  Estimated  Demonstration  System  Requirements 

System  requirements  for  the  experimental  demonstration  system  were  founded  on  the 
assurtqition  that  a  head  up  display  (HUD)  would  {xesenc  sensw  derived  imagery  of  the  airport 
scene  and  essential  avionics  information  that  would  enable  the  pilot  to  manually  perform  the 
approach,  flare,  landing,  rollout  and  taxi,  in  spite  of  low  visibility  conditions.  Imagery  and 
position  related  avionics  information  would  be  [sojected  (X}nfonnally  in  position  and  scale,  such 
that  in  visual  conditions,  image  features,  such  as  the  runway,  on  the  HUD  would  perfectly 
correspond  with  the  real  world.  The  system  would  ideally  be  independent  of  ground  based 
navigation  aids  and  would  have  sufficient  reliability  to  meet  experimental  aircraft  certification 
requirements. 

•  System  Requirements.  The  team  proposed  the  following  functional  system  requirements: 

-  Minimum  range  for  runway  acquisition:  7000  feet  from  the  threshold. 

-  Accurate  horizontal  and  vertical  image  registration. 

-  Image  processing  in  real-time ,  (i.e.  negligible  display  latency ). 

-  Obstacle  detection  sufficient  to  confirm  a  clear  runway. 

-  Enable  touchdown  accuracy  laterally  within  27  feet  of  centerline,  and  longitudinally 
within  700  feet  of  the  touchdown  zone. 

-  Provide  flare  cues  to  enable  touchdown  accuracy. 

-  For  fail  operational  system  components,  probability  of  failure  lO"^ 
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•  Sensor  Requirements. 

The  following  key  sensor  requirements  were  proposed  to  provide  an  adequate  imagery  system: 

-  Azimuth  resolution  (beamwidth):  desired,  0.7<^  maximum 

-  Signal  to  Noise  Ratio:  15  dB  minimum. 

-  Minimum  acquisition  ranges:  7000  feet  (landing),  1500  feet  (taxi) 

-  Elevation  of  obstacles  must  be  depicted  during  taxi  operations. 

-  Image  update  rate:  15  Hertz  desired,  10  Hertz  minimum. 

-  Held  of  View:  azimuth  35^  with  180<)  slew  range,  by  elevation  IXP  to  allow 
+3®, -17®  pitch. 

-  Form  and  Et  compatible  with  commercial  transport,  such  as  C-130. 

-  Sensor  controls:  automatic  frequency  and  gain,  and  manual  contrast  and  brightness. 

-  Stabilization  in  Pitch,  roll  and  heading,  with  manual  heading  adjustment. 

•  Image  Processing  Requirements. 

The  required  extent  of  image  enhancement  is  dependent  on  system  design  and,  in 
particular,  on  the  inherent  performance  of  the  sensor.  A  sensor  that  already  produces  high 
contrast  and  high  resolution  requites  less  image  enhancement  At  the  most  promising  millimet» 
wavelengths,  the  space  limitations  for  the  antenna  aperture  tend  to  reduce  gain  and  resolution. 
Also,  at  the  shorter  wavelengths,  limitations  in  transmission  power  can  decrease  image  contrast 
Consequently,  in  addition  to  the  items  listed  below,  contrast  enhancement  edge  sharpening  and 
deconvolution  techniques  may  be  required  to  improve  the  "raw”  sensor  output. 

-  Produce  imagery  with  a  minimum  of  8  shades  of  grey. 

-  Fcm-  RADARs,  provide  for  accurate  measurement  of  height  above  runway 
for  scan  conversion. 

-  Compute  accurate  geometric  corrections  for  all  aircraft  attitudes. 

•  Display  Requirements. 

The  HUD  must  provide  a  useful  display  in  a  variety  of  cockpit  ambient  lighting  and  scene 
llumination  conditions.  The  following  minimum  requirements  were  proposed: 

-  Simultaneous  display  of  raster  video  (RS-170)  and  stroke  symbology. 

-  Field  of  view:  minimum  35®  wide  by  20®  high. 

-  Form  and  fit  compatible  with  commercial  transport  cockpit. 

-  Reflective  holographic  combiner. 
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3^1^  Technical  and  Systons  Ismes  To  Be  Resolved. 

The  team  found  several  issues  needing  resolution.  They  are  summarized  below: 

Sensors. 

-  Is  the  optimum  technology  active  radar  or  passive  radiometer? 

-  Is  35  GHz  or  94  GHz  the  best  frequency? 

-  Is  infrared  (FLIR)  useful  for  some  operations?  If  so,  at  3  to  S  microns  or  8  to  12? 
Image  Processing. 

-  How  much  and  what  kinds  are  required? 

-  Can  required  image  processing  be  performed  at  the  required  image  update  rate? 
Registration. 

-  Can  the  accuracy  of  image  and  HUD  registration  be  achieved  and  maintained? 

HUD  Symbology. 

-  What  information  must  be  displayed  and  is  it  compatible  with  the  display  of  the 
imagery? 

Weather  Models. 

-  Are  current  models  sufficient  to  predict  sensor  performance  in  all  weather  conditions? 
Reliability. 

-  Can  the  required  levels  be  realized? 
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SENSOR  DEVELOPMENT 

The  objective  of  the  sensor  development  effort  was  to  obtain  at  least  one  imaging, 
weather  penetrating  sensor  to  enable  flight  demonstration  of  the  Synthetic  Vision  concept  in 
zero-zero  conditions.  Sensor  development  was  necessaiy  because  an  existing  sensor,  satisfactory 
for  flight  demonstration  of  the  Synthetic  Vision  concept,  had  not  been  found.  Nevertheless, 
sensor  technology  did  seem  to  be  sufficiently  advanced:  so  the  need  was  to  redesign  current 
technology  into  a  suitabte  package  for  the  flight  demonstration.  It  was  estimated  that  the  sensor 
development  would  take  a  manufacturer  twelve  months,  at  an  estimated  cost  of  $2  million, 
including  the  follow  on  test  support. 

3.2.1.  Demonstration  Sensor  System  Guidelines  for  Bidders 

The  guidelines  provided  to  potential  bidders  for  development  of  the  demonstration  soiso' 
system  stated  that  to  support  low  visibiliQr  landing  qierations,  the  sensor  must  produce  an  image 
of  the  runway  and  adjacent  con^lex  at  long  enough  ranges  to  permit  a  safe  descent  The  image 
of  the  runway  must  have  sufficient  contrast  and  resolution  to  enable  the  pilot  to  detect  it  identify 
it  and  track  its  location.  The  sensor  system  with  the  integrated  aircraft  avionics  and  headup 
display  (HUD)  must  accurately  register  thef  image  with  the  outside  view  and  ccaiect  foraircraft 
roll,  pitch  and  yaw  maneuvers.  Finally  the  sensor  must  produce  the  image  with  a  variety  of 
surface  materials  and  conditions,  and  through  a  variety  of  atmospheric  obscurants  (fog,  rain, 
snow).  Precise  specifications  were  difficult  to  define  so  the  following  guidelines  were  provided 
to  the  bidders: 

-  Range  (kilometers):  Enable  Runway  Detection  S 

Enable  Runway  Identification  3 

Confirm  Obstacle  Clear  Runway  2 

-  Assume  three  degree  glide  slope. 

-  System  must  be  entirely  self-contained;  no  ground  aids  required  to  land. 

-  Capable  of  supporting  flight  evaluations/demonstrations  in  fog,  rain  and  snow. 

-  Form,  fit  and  function  capable  of  integration  on  executive  class  jet  aircraft;  like 
Gulfstream  -  Produce  image  in  real-time  and  in  real  world  perspective  for  display  head  up. 

The  project  expected  to  learn  more  about  systems  requirements  from  the  first  phase  of  the 
development  contracts  in  which  design  studies  and  technology  tradeoff  analyses  would  be 
performed. 
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3^  Competitive  Procurement. 

The  Air  Force  Flight  Dynamics  Directors  at  Wright  Patterson  AFB  conducted  the 
con^titive  iax)curement  for  sensor  development  using  a  Program  Research  and  Development 
Announcement  Requirements  could  be  genially  described  in  the  announcement  and  the 
bidders  would  provide  more  detail  in  their  proposals,  and  if  selected,  in  their  I%ase  1  design 
studies.  The  project  allocated  $4  million  for  this  multi-award,  firm-fixed  price,  four  {rfiase  ^oct 
The  government  retained  the  right  to  discontinue  die  contracts  at  the  end  of  each  phase.  Thefour 
phases  were: 

Phase  1  -  Design  Study.  A  two  month  effort  to  perform  trade-off  analyses  of  promising 
technical  approaches  and  a  detailed  sensor  design.  The  govemnwnt  expected  to  select  four 
contractors  for  this  phase  at  iqiproximately  $150  thousand  each,  and  select  a  subset  of  these  for 
fabrication  and  testing. 

Phase  2  -  Fabrication.  A  ten  month  effort  in  which  the  selected  c(»itiacto((s)  would  build 
an  airworthy  brassboard  sensor  that  could  be  modified  with  minimum  effort  for  test  aircraft 
integration  and  flight  test  The  contractors  were  required  to  analyze  and  report  on  the  risk  of 
aircraft  integration  two  months  before  completion  of  the  this  phase. 

I%ase  3  -  Test  Support  Selected  contractors  would  provide  on-site  assistance  for  the 
installation,  calilnation,  maintenance  and  data  coUecdcai  during  sensor  performance  testing  at  die 
Wright  Laboratory  Tower  facility  and  aboard  the  test  aircraft  The  government  and  contractocs 
would  share  all  data  from  their  respective  sensor  tests. 

Phase  4  -  Final  Report  The  contractor(s)  would  provide  data  and  technical  advice  to  the 
tower  test  (XMitractorCGTRI)  for  the  preparation  of  the  senstx’performance  test  report  and  write  a 
separate  report  from  their  point  of  view. 

Ten  bidders  submitted  proposals  and  of  these,  four  were  awarded  Phase  1  contracts 
totalling  $576,000.  These  four  provided  a  good  cross  section  of  candidate  technologies.  They 
were: 

-  Eastman  Kodak  proposed  a  3-5  Micron  platinum-silicide  forward  looking  infitired 

radiometer. 

-  Martin  Marietta  proposed  a  35  GHz  pulse  radar  with  an  electro-mechanical  scanning 
antenna. 

-  Lear  Astronics  proposed  a  94  GHz  FMCW  Radar  with  a  mechanical  scarming  Anterma. 

-  TRW  proposed  a  passive  94  GHz  focal  plane  array  radiometer. 
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FbUowing  evaluation  of  the  design  studies,  the  Synthetic  Vision  project  chose  one,  the 
Lear  Astronics  design,  for  Phase  2  Fabrication.  The  Kodak  FUR  offered  impressive 
perfbnnanoe,  but  according  to  the  manufacturer's  analysis  could  not  promise  sufiBcient  range  in 
fog  and  rain  to  serve  as  the  piimaty  sensor.  The  TRW  94  GHz  radkaneter  was  a  very  interesting 
system,  but  a  cmifiguration  with  sufficient  field-of-view  could  not  be  fabricated  in  time  die 

flight  activity. 

The  Flight  Dynamics  DirectCMate,  in  association  with  the  Avitxiics  Directorate,  the  Navy, 
Rome  Air  Develqment  Center,  and  others,  proceeded  widi  fabrication  of  the  Kodak  FUR  and  a 
modified  configuration  of  the  TRW  radiometer.  Both  are  passive  sensor  designs. 

3.13.  94  GHz  Radar  Fabrication. 

The  Phase  2  fixed  price  contract  was  awarded  to  Lear  Astronics  in  late  June  1990  and 
required  delivery  of  a  working  system  by  the  end  of  April  1991 .  The  fabrication  schedule  was 
extremely  aggressive,  however  the  sensor  was  not  ready  by  April  1991.  By  the  end  of  May, 
believing  the  radar  lacked  sufficient  performance,  the  contractor  attenqited  to  enhance  it  with 
new  amqponents  to  increase  power  and  reduce  system  losses.  As  a  result  of  these  difficulties,  die 
government  sought  to  arrange  an  acceptance  test,  in  August  1991,  prior  to  a  I%ase  3 
commitment  In  January  1992,  after  xveral  attenqits  to  reach  an  agreement,  die  govemmoit 
accepted  delivery  of  the  system  and  terminated  the  contract  without  proceeding  to  Hiase  3. 
Later,  Lear  Astrmics  made  new  arrangements  to  conduct  an  accqitance  test  and  proceed  to  die 
test  aircraft,  under  a  subcontract  to  the  prime  crmtractor  for  flight  integration  and  testing,  TRW. 

The  sensor  in  the  configuration  in  which  it  was  tested  in  the  tower  is  shown  in  Figure  4. 

3.14.  35  GHz  Sensor  Procurement  and  Fabrication 

Because  only  one  sensor,  the  Lear  Astronics  94  GHz  radar,  was  chosen  for  the 
competitive  development,  the  project  lacked  the  means  to  test  and  characterize  35  GHz 
performance.  A  search  for  35  GHz  sensors  yielded  a  relatively  low  cost  solution;  an  existing 
radar  built  for  another  Air  Force  application.  To  be  assembled  with  components  fiom  the 
manufacturer,  Honeywell,  Inc.,  and  the  Air  Force,  this  system  would  be  tested  at  the  tower  to 
obtain  the  desired  35  GHz 
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Figure  5.  Honeywell  35  GHz  SVS  Imaging  Radar  Components 
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3J.  SENSOR  TOWER  TESTING. 


Sensors  that  can  produce  images  of  the  lurport  scene  through  fog  and  precipitaticMi 
represent  the  key  enabling  technology  for  Synthetic  Vision.  Primary  objectives  of  the  tower 
tests  were  to  calitette  each  sensor,  develop  a  perfmmance  data  base,  d^ermine  perfonrumoe  in 
clear  weather,  determine  performance  in  low  visibility  fog,  rain  and  snow  ctmditions,  and 
establish  suitability  for  flight  testing.  An  additional  objective  was  to  learn  as  ii^ich  as  possible 
about  the  characteristics  of  the  low  visibility  weather  conditions  that  affected  sensor 
performance. 

The  Wright  Laboratory  Avionics  Directt^ate  owns  and  operates  the  Target  System 
Characterization  Facility,  otherwise  called  the  tower  facility  at  Wright  Patterson  AFB,  which 
overlooks  a  heavily  instrumented,  non-operational  runway  coitq>lex  at  a  look-down  angle  of  3.5 
degrees  as  shown  in  Hgure  6.  A  top  view  drawing  of  the  area  with  some  of  the  key  landmarks  is 
provided  in  Figure  7.  It  is  an  ideal  site  for  sensor  testing  in  a  controlled  environment  The 
elevated  sensor  test  position  at  the  tower  was  equipped  by  the  S  VS  Program  with  a  precision 
data  acquisition  system  consisting  of  an  automated  motion  table,  computer  with  high  c^ncity 
hard  drives  and  digital  frame  grabber,  high  resolution  canocorder,  video  recorders,  video 
monitors,  and  blackbody  calibration  sources.  GTRI  designed  the  data  acquisition  system  and 
wrote  software  that  automated  data  collection  and  also  allowed  "quick  looks”  at  die  data  throu^ 
imagery  and  signal  levels  to  monitor  test  progress  and  data  quality.  The  runway  scene  was 
equipped  with  calibrated  reflectors  for  millimeter  wave  measurements  and  an  extensive 
metecnological  measurement  suite.  This  suite  enabled  the  collection  of  tenqierature,  radiance, 
humidity,  rain  rate,  drc^  size,  and  visual  range  data  at  high  sanqile  rates.  TheWright-Patterson 
AFB  weather  station  provided  tailored  forecasts  and  observations  in  support  of  the  tests. 
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Figure  6.  Elevation  drawing  of  test  area. 
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The  scene  dimensions,  feature  locations,  and  surface  materials  were  surveyed  to  provide  precise 
ground  truth  for  comparison  with  sensor  performance. 

The  Air  Force  Wright  Laboratory  Control  Systems  Development  and  Applications 
Branch  assumed  responsibility  for  the  planning  and  ctmduct  of  the  tower  tests  and  assigned  a 
Tower  Test  Director.  The  Tower  Test  Directs  served  as  the  technical  point  of  ccmtact  for  the 
procurements  of  test  equipment,  metecxological  instrumentation  and  data  reduction,  sq)arate 
contracts  with  sensor  providers,  and  the  contract  for  the  Tower  Test  Support  with  CTRL  The 
Tower  Test  Director  managed  the  development  and  publication  of  the  Tower  Test  Plan  which 
served  not  (mly  die  Synthetic  Vision  project,  but  also  other  sensor  test  tasks  at  the  same  fadliQr. 
The  Synthetic  Vision  Program  OfGce  defined  test  objectives.  GTRI,  and  the  technical 
consultants  wrote  major  technical  sections  such  as  the  requirements  for  data  elements, 
instrumentation,  analysis  methodology,  data  management,  and  test  procedures  fw  the  various 
types  of  sensors.  The  plan  was  completed  and  approved  in  May  1991.  GTRI  had  primary 
reqionsibility  for  the  actual  data  management,  reduction,  and  analysis.  Preliminary  sensor  tests 
were  conducted  during  that  summer  to  validate  and  refine  the  test  {daiL  It  was  revised  in  August 
1991  to  add  the  detailed  "Radar  Method  ofTest"  and  in  February  1992  to  add  the  detailed  "IR 
Method  of  Test"  (not  a  full  scale  tower  test)  was  conducted  in  August  1992.  The  Tower  Test 
Schedule  is  shown  in  Figure  8. 

The  Tower  Test  Han  required  tiiat  baseline  tests  of  each  sensOT  be  cmducted  to  calibrate 
the  system  parameters  and  provide  the  ideal  clear  air  performance  CCTitrol  data  set  for  conyarison 
with  senswperfonnance  in  fqg,  tain  and  snow.  The  planned  test  matrix  called  for  a  minimum  of 
twelve  complete  data  tuns  of  four  different  weather  categories  with  three  runs  each.  The  four 
categcnies  were  clear  air,  fog,  rain  and  snow.  The  maximum  prevailing  visibility  fw  the  latto* 
three  categcaies  was  1  l/2miles.  Fca  the  infiatedsenscas,  24  hour  duration  diurnal  baseline  tests 
were  conducted  because  of  the  perfc  tnance  dependencies  on  sun  angle,  thermal  history,  and 
time  of  day. 
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Figure  7.  Top  View  Drawing  of  Test  Area 
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Figure  8.  Synthetic  Vision  Sensor  Tower  Test  Schedule 


33.1  Sensor  Characteristics 


33.1.1  MMW  Radar  Sensors 

A  miilimeter-wave  (MMW)  radar  sensor  exploits  the  differences  in  radar  cross  section 
between  paved  runway  ai^  bordering  grass  surface  areas  to  image  a  runway  scene,  as  shown  in 
Figure9.  Radar  cross  secti(xi(RCS)  is  a  measure  of  a  target's  abibty  to  reflect  radar  waves.  At 
the  low  incident  angles  encountered  by  an  synthetic  vision  (SV)  radar,  most  of  the  radar 
illumination  energy  is  forward  scattered  from  the  smooth,  low-RCS  nmway,  and  voy  little  is 
backscattered  to  the  radar  receiver.  The  "rougher”  grass  areas  have  medium  RCS  and  return  a 
higher  portirHi  of  the  incident  radar  energy.  A  radar  reflector  is  designed  specifically  to  have 
high  RCS  and  backscatters  a  large  portion  of  the  incident  radar  energy. 


Figure  9.  MMW  radar  detection  of  a  runway. 

MMW  sensors  were  selected  for  tower  testing  that  could  image  the  example  runway  scene 
with  sufficient  resolution  to  demonstrate  synthetic  vision  sensor  technology.  Initially,  the 
primary  MMW  test  soiSOT  was  a  94  GHz  radar  de^^lcqxd  by  Lear  Astrcmics  under  the  Air  Force 
Program  Research  and  Development  Announcement  (PRDA)  #89-4-PMRN.  Late  availability  of 
the  Lear  sensor  for  tower  testing  led  to  the  inclusion  of  a  substitute  95  GHz  radar  sensor  ficnn 
Norden  Systems  for  the  purpose  of  collecting  data  at  the  94-95  GHz  frequency.  The  Norden 
TALONS  radar  pod  was  adrq>ted  fiom  its  flight  test  configuration  to  collect  radar  performance 
data  througjh  the  winter  rocmths.  An  Air  Force  35  GHz  radar  sensor  had  successfully  imaged  the 
runway  scene  in  1990  under  another  project  sponsored  by  the  FAA  and  Air  Force,  so  the  Air 
Force  35  GHz  sensor  was  tested  early  in  this  project.  During  1991-1992,  Honeywell 
Incorporated  developed  a  flight  test  configuration  35  GHz  radar  sensor  with  scanning  antenna 
that  was  also  tested  at  the  tower. 
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The  conqdete  q[)erating  specifications  for  each  test  sensor  were  determined  at  least  <»ice 
during  the  testing  period.  Some  characterizatkm  activities  required  paitial  disassembly  of  the  test 
sensor  and  the  use  of  special  puipose  test  equipment,  so  more  fiequent  measurement  of  these 
parameters  was  not  pxacticaL  Some  of  the  q)ecificati(ms  had  to  be  ascertained  fimn  previous  off¬ 
site  measurements  at  from  manufacturer's  test  data.  The  six  mmw  radar  sensors  tested  at  tiie 
tower  and  tlreir  pertinent  specifications  are  listed  in  Table  1. 

Table  1.  MMw  Radar  Sensors  Tested  At  Tower 


Sensor 

Code 

Manufacturer 

Frequency 

Waveform 

Antenna 

/Polarization 

Signal 

Processor 

Remarks 

lAl 

Lear  Astronics 

94  GHz 

FMCW 

parabolic* 

/circular 

DSP 

develop¬ 

mental 

LA2 

Lear  Astronics 

94  GHz 

FMCW 

parabolic** 

/vertical 

DSP  &  EVS 

SVTD 

candidate 

NSl 

Norden  Systems 

95  GHz 

pulsed 

parabolic 

/circular 

none 

non¬ 

candidate 

Hll 

U.S.  Air  Force 

35  GHz 

pulsed 

slotted  W/G 
/horizontal 

none 

non¬ 

candidate 

HI2 

Honeywell  Inc. 

35  GHz 

pviised 

slotted  W/G 
/circular  t 

DSP 

SVTD 

candidate 

HIS 

Honeywell  Inc. 

35  GHz 

pulsed 

slotted  W/G 
/horizontal 

none 

non¬ 

candidate 

*  Front-fed  dual  parabolic  reflector  with  gear  drive 
**  Cassegrain  fed  duai  paraboiic  reflector  with  resonant  scan 
t  Slotted  waveguide  fed  reflector  with  eiectromechanical  "Eagle  scan” 

Abbreviations:  W/G  -  waveguide,  DSP  «  digital  signal  processor,  EVS  -  video  processor 

A  sensOT  configuration  code  based  on  the  manufacturer's  name  and  a  configuration  sequence 
number  was  establislred  to  label  the  data  from  each  sensor  tested.  Two  configurations  of  the 
Lear  Astrcmics  94  GHz  radar  sensor,  an  Air  Force  35  GHz  radar  srasor,  and  two  configurations 
of  Honeywell  35  GHz  radar  sensors  were  tested;  the  configuratitms  diffned  in  antenna  selection, 
transmitter,  and  signal  processor.  The  Norden  Systems  TALONS  95  GHz  radar,  although  not 
considered  a  candidate  Synthetic  Vision  sensor,  provided  the  most  extensive  set  of  MMW  radar 
adverse  weather  performance  data  collected  on  this  project  Only  the  LA2  and  HI2  radars  were 
SVTD  candidate  MMW  radar  sensors  and  continued  on  to  flight  testing. 

33.1,2.  Infrared  Sensors 

An  infrared  (IR)  sensor  is  able  to  image  a  runway  scene  based  on  the  differences  in 
temperature,  emissivity,  and  reflectivity  of  the  pavement  areas  and  the  bordering  grassKxrvered 
areas,  as  shown  in  Hgure  10.  An  IR  camera  receives  thermal  radiance  from  the  scene  surfaces, 
and  a  lens  focuses  that  energy  on  a  sensitive  detector  element  or  array  of  elements.  The 
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wavelength  range  accepted  by  an  IR  camera  is  based  on  the  type  of  sensitive  detector  element 
used.  Image  contrast  is  develq)ed  by  the  differences  in  radiance  received  from  the  typically 
warmer  pavement  and  the  typically  cooler  grass  areas  within  an  airport  scene.  The  actual 
radiance  difference  is  a  function  of  environmental  heating  and  cooling  during  the  daily  cycle, 
grass  moisture,  and  meteorological  events. 

The  IR  sensor  systems  used  in  the  SVTD  program  to  collect  data  in  the  3  to  S  micron 
infrared  band  were  focal  plane  array  cameras  with  Stiriing-cycle  refrigeration  for  sensor  cooling. 
Most  of  the  infrared  image  data  were  collected  with  the  Kodak  Model  KIR-310  infrared  camera 
system,  shown  in  Figure  1 1  as  it  was  installed  in  the  tower  test  facility.  Image  data  were  also 
acquired  with  a  MOitsubishi  Electric  Qxpcxatiai  model  IR-5120C  infrared  camera.  Bodi  of  diese 
instruments  utilized  platinum-silicide  (PtSi)  focal  plane  array  sensors  and  provided  the  image 
data  in  an  RS- 170  video  signal  format.  Important  characteristics  of  the  two  camera  systems  are 
listed  in  Table  2. 
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HgurelO.  IR  detection  of  a  runway. 
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Figure  11.  Kodak  3>5  micron  Sensor  System  Used  In  Tower  Tests 
Table  2.  Characteristics  Of  Camera  Systems 


Charaaeristic 

Kodak  KIR-310 

Mitsubishi  IR-5120C 

Deteaor 

PtSiFPA 

tSiFPA 

Number  of  array  elements 

640X486 

512X512 

Response  band 

3.2-4. 1  microns 

3-5  microns 

Lens  focal  length 

27.S  mm 

50  mm 

Lens  aperture 

f/1.7 

f/1.2 

Field  of  view 

32'X25* 

14-xir 

NEDT  (Noise  Equivalent 

Difference  Temperature ) 

0.17*  C 

0.15*  C 

Cooling  method 

Stirling  cooler 

Stirling  cooler 

Analog  output 

RS-170  video 

RS-170  video 
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232.  Sensor  Performance  Measures 


Sensor  peifmnance  features  are  a  measure  of  a  sensor’s  effectiveness  in  imaging  die  aupoit 
scene  and  are  specific  to  the  individual  sensor  design.  Phenomenology  characterizes  the  test 
scene  environment  in  fundamental  engineering  values  that  are  related  to  the  senstH*  wavelength 
but  are  indq)endent  of  a  particular  sensor  design.  Resolution  and  contrast  are  exartq)les  of  sensrx- 
perf(»mance  features.  Examples  of  {^nomenology  values  are  radar  cross  sectirxr  fix’  a  target  or 
clutter  area,  volumetric  radar  cross  section  fix  piecipitati(»,  and  atmosidretic  attmuatiotL  Radar 
phenomenology  values  are  fiequency  sensitive. 

23,2.1.  Performance  Features 

Sensor  data  collected  during  tower  tests  were  processed  to  extract  the  specific  sensor 
performance  features  listed  in  Table  3.  These  performance  features  were  selected  to  rq>ply 
equally  well  to  the  MMW  and  IR  imaging  soisors  tested  at  the  tower.  Prior  to  feature  extraction, 
the  "raw"  senstx  data  were  converted  into  standard  units  of  measure  ^)propriate  to  each  soisor 
technology.  MMW  radar  sensor  data  were  calibrated  to  units  of  equivalent  received  power,  and 
IR  sensor  data,  to  units  of  equivalent  received  radiance.  The  term  "signal"  in  this  context  refers 
to  the  anq)litude  values  of  the  calibrated  sensor  data.  The  specific  formulas  for  calculating  the 
performance  features  are  presented  in  Sections  7.1  (MMW)  and  7.2  (IR)  of  Volume  2  (Senstx 
Tower  Testing)  of  this  report. 
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Tables.  Sensor  Performance  Features 


Feature  Name 

Description 

Contrast 

C 

Difference  in  received  signal  between  runway  and 
background  (grass)  areas,  normalized  to  tte 
background  signal. 

Signal-to-vaiiability  ratio 

SVR 

Ratio  of  received  signal  to  the  standard  deviation 
of  received  signal. 

Sharpness 

S 

Reciprocal  of  the  horizontal  angle  between  two 
areas  of  differing  signal  level. 

Range  (or  elevation 
angle)  resolution 

DR 

Smallest  range  or  angle  at  which  two  objects  can 
bt  resolved  by  the  sensor. 

Azimuth  resolution 

DA 

Smallest  horizontal  angle  at  which  two  objects  can 
be  resolved  by  the  sensor  within  3  (ffl. 

2  Phenomenology 

nienoiiienology  is  the  science  of  observing  physical  events.  Radar  and  IR  phenomenology 
observe  the  le^nses  of  the  envircHunent  to  an  electromagnetic  sensor.  The  measured  re^nses 
are  ntmnalized  to  units  of  distance,  area,  or  volume,  so  that  the  results  can  be  expressed  in  valties 
independent  of  the  specific  test  sensor  used  to  make  the  measurements.  Phenomenology  values 
are  usefiil  for  predicting  the  performance  of  other  MMW  or  IR  sensors  in  a  similar  operating 
envircMiment  The  phenomenology  features  that  were  extracted  from  the  MMW  radar  sensor  data 
are  listed  in  Table  4,  along  with  a  brief  description. 
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Feature  Name 

Ablneviatioo 

Description 

Normalized  RCS 

oo 

Radar  cross  section  per  unit  area  of  surface. 

Atmoqdieric  attenuation 

a 

Re(hicti<»  of  apparent  target  RCS  due  to  airtxHne 
material  (liquid  water). 

Volumetric  RCS 

Ov 

RCS  of  the  airborne  water,  normalized  to  volume. 

A  calibrated  radar  senscx'  can  measure  the  RCS  of  a  target  or  clutter  area  by  substitutiiig 
received  power  values  into  the  radar  range  equatitm  and  solving  ftx*  RCS.  The  resulting  RCS  is 
expressed  in  units  of  square  meters  or  decibels  relative  to  one  square  meter  of  RCS.  This  RCS 
measure  is  sq^(Mx>priate  for  characterizing  a  "point"  target  such  as  a  vehicle  or  an  area  of  clutter 
conq)rised  of  collection  of  objects,  either  natural  or  man-made.  Radar  clutter  can  be  localized, 
such  as  a  single  tree,  or  distributed  over  relatively  homogeneous  extended  surface  areas,  such  as 
pavement  or  grass. 

Conditions  in  the  intervening  atmosphere  between  a  MMW  radar  and  a  target  can 
degrade  the  radar's  ability  to  detect  and  image  that  target,  as  shown  in  Figure  12.  Airborne 
moisture  due  to  fog  and  precipitation  (rain,  sleet,  ch:  snow)  causes  scattering  and  diffusitm  of  the 
radar's  electromagnetic  waves.  Atmospheric  effects  are  separated  into  attenuation  and 
volumetric  backscatter. 


Attenuation  is  the  loss  of  apparent  target  RCS  due  to  the  intervening  atmosphere. 
Atmosj^ronc  attenuation  applies  over  the  entire  radar  propagation  path,  from  the  radar  to  the 
target  and  back  to  the  radar,  or  twice  die  target  slant  range  for  a  monostadc  radar  (Le.,  one  with 
the  transmitter  and  receiver  collocated).  Attenuation  reduces  the  range  at  which  a  radar  can 
resolve  runways  from  bcmlering  grass  areas,  due  to  a  reductitm  in  apparmt  grass  clutto:  RCS  and 
runway  clutter  RCS. 


Q 

AtmosplMrie  Attanualion 
(Path Loss)  dB/km 


Surfaeo  Conditions:  Diy,  WsL  SnowCovor 


Figure  12.  Meteorological  effects  on  MMW  radar  sensors. 

Volumetric  reflectivity  is  the  RCS  of  aiibome  particles  within  the  radar  beam  per  unit  volume. 
MMW  volumetric  reflectivity  is  very  low  for  fog,  is  relatively  low  for  snow,  but  can  be 
significant  for  rain. 

3JJ.  Test  Data  Matrix  For  MMW  Sensors 

The  tower  test  data  matrix  fw  the  Honeywell  35  GHz  (HXZ)  and  Norden  95  GHz  (NSl) 
radar  sensors  is  presented  in  Figure  13a,  grouped  by  observed  weather  conditions,  and  in  Hgure 
13b,  sorted  by  along-path  visibility  (LPY)  in  feet.  Although  there  were  several  runs  with 
weather  conditions  of  fog,  the  visibility  was  usually  greater  than  1,700  feet  (520  m).  Conditions 
of  low-visibility  fog  did  not  occur  at  the  tower  during  the  sensor  test  periods.  Note  that  the 
numbers  of  measurement  tuns  listed  are  those  that  were  processed  by  GTRI  fimn  among  a  larger 
set  that  were  collected.  Table  5  presents  a  more  detailed  MMW  data  matrix  for  all  six  sensor 
configurations  tested.  The  total  numbers  of  runs  collected  and  processed  for  each  sensor 
configuration  are  shown,  along  with  the  numbers  of  processed  runs  sorted  by  meteorological 
conditions. 
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Figure  13a.  MMW  Test  Data  Matrix  Sorted  by  Observed  Weather. 
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Figure  13b.  MMW  Test  Data  Matrix  Sorted  by  Along-Path  Visibility 
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Tables.  MMW  Radar  Sensor  Data  Matrix 


MMW  Sensor 
Description 

Measurements 

PEifiuned 

Total  Runs 

Number  of  (hv 

Meteorological  Conditions) 

Collected 

Processed 

dear 

Snow 

Fbg 

Ram 

F&R 

Lear  development 
system 

3 

3 

3 

0 

0 

B 

D 

Learfli^^stem 

acceptance  test 

6 

3 

3 

0 

0 

0 

0 

Norden  TALONS 

full  matrix 

16S 

76 

D 

25 

14 

33 

0 

Honeywell 
devel^ment  system 

sample  tuns 

11 

6 

6 

0 

0 

0 

0 

Hone^  i  flight 
system 

full  matrix 

46 

35 

5 

3 

3 

20 

■ 

Honeywell  spare  unit 

25 

13 

2 

0 

9 

2 

a 

The  very  late  delivery  of  the  94  GHz  sensor  to  the  tower  facility  precluded  testing  of  the 
sensor  in  any  conditions  other  than  clear  air. 

33 A,  MMW  Sensors  Baseline  Performance 


Analysis  of  the  performance  of  the  MMW  sensors  in  clear  weather  established  a 
performance  baseline  against  which  the  effects  of  weather  could  be  determined.  Baseline 
measurements  also  allow  ccm^nrisoiis  of  percdved  image  quality  to  the  operating  parameters  of 
diese  particular  radar  sensors.  Figure  14  shows  how  die  radar  lesolutioD  cell  sizes  at  2  km  range 
compare  with  the  width  of  dte  runway  at  the  tower  test  scene.  The  radar  resolutitm  cell 
dimensions,  downrange  and  cross-range,  are  defined  by  the  range  and  azimudi  tesolutkm  of  die 
radar  sensor,  respectively.  The  fine  grid  ovoiay  represents  the  sanqiling  resolution  of  the  data 
acquisition  system  (DAS),  which  in  every  case  exceeded  the  sensor  resolution.  DAS 
oversampling  gave  a  constant  data  set  resolutirai  indqiendent  of  the  MMW  sensor  under  test  and 
provided  additional  sample  points  for  averaging. 
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Downrange  profiles  of  equivalent  received  power  are  a  good  method  of  rating  a  MMW 
radar  senscx's  ability  to  disaiminate  the  nmway  from  the  bordering  grass  areas.  Asdescribedin 
Volume  2  (Sensor  Tower  Testing)  of  this  report,  a  series  of  patch  areas  were  defined  alcmg  the 
runway  and  grass  for  data  processing  purposes.  A  downrange  power  profile  plot  presents  the 
equivalent  received  power  values  from  the  patches  spaced  alcmg  the  grass  and  runway  between 
I,7(X)m  and  3300  m  range.  Figure  ISa  is  a  downrange  power  profile  for  the  35  GHz  radar,  and 
Figure  ISb  is  the  same  profile  for  the  NcHxiai  95  Gib  radar  senses.  Hgure  16  is  a  similar  profile 
for  the  Lear  Astronics  94  GHz  radar  sensor.  Curves  have  been  fit  to  the  points  from  the  grass 
patches  (plus  signs)  and  the  runway  patches  (solid  squares).  The  difference  in  received  pown 
between  the  grass  patches  and  the  runway  patches  provided  by  the  radar  sensOT  is  ctmvnted  by 
the  signal  processor  into  unage  contrast  This  power  difference  decreases  with  range  and  in 
weather,  reducing  the  resulting  image  contrast  and  the  detectability  of  the  runway. 
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Figure  ISa.  35  GHz  Downrange  Power  Profile 


Figure  15b.  95  GHz  Downrange  Power  ProHle 
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Figure  16.  94  GHz  Downrange  Power  Profile 


33.5.  MMW  Radar  Tower  Test  Results 


Sufficient  MMW  sensor  data  from  the  Honeywell  35  GHz  and  Norden  95  GHz  radars 
woe  collected  during  the  tower  tests  to  rqxzt  srasor  porfonnance  results  for  a  variety  of  weather 
conditions.  Of  these  two  MMW  sensors,  only  the  Honeywell  35  GHz  radar  was  designed 
specifically  to  perform  the  runway  imaging  mission.  The  Norden  95  GHz  radar  was  not 
designed  for  high-resolution  runway  scene  imaging,  but  it  provided  valuable  test  data  on  the 
adverse  weather. 

Results  fOTthe  Hon^well  35  GHz  and  N(xdm  95  GHz  radar  sensors  are  summarized  in 
Figure  17  fix  the  three  performance  categories  of  omtrast,  signal-to-variabili^  ratio  (SVR),  and 
sharpness.  35  GHz  and  95  GHz  performance  categories  are  graphed  side-by-side  for  the  six 
weathor  conditions  of  clear,  medium  snow,  light  fog,  voy  light  rain,  light  rain,  and  medium  raitL 
These  performaiKe  values  are  for  rtmway  and  grass  at  2  km  range.  The  heights  of  the  bats,  x 
relative  performance  factors,  have  been  normalized  to  the  maximum  value  measured  by  these 
two 

sensc»s.  No  shatimess  values  could  be  extracted  from  the  95  GHz  data  for  the  higher  rain  rates. 
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Figure  17.  MMW  Sensor  Perfomumce  at  2  km  in  Clear  Air,  Fog,  Snow,  and  Rain 
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The  relative  performance  advantage  of  this  35  GHz  sensor  over  the  95  GHz  sensor  in 
clear  weather  is  due  to  the  design  parameters  of  these  particular  radars  and  not  due  to  any 
fundamental  limitations  of  the  95  GHz  frequency  band  for  runway  imaging.  The  (tegradaticm  in 
performance  with  increasing  precipitation  for  each  MMW  sensor,  relative  to  its  own  clear 
weather  performance,  does  reflect  the  greater  impact  of  precipitation  at  95  GHz. 

The  numeric  values  for  the  MMW  performance  parameters  plotted  above  are  listed  in 
Table  6.  Contrast  is  probably  the  petfonnance  critaia  that  contributes  most  to  runway  detection 
by  a  MMW  synthetic  vision  sensor.  Fortunately,  contrast  for  the  35  GHz  radar  was  high  and 
remained  accqjtably  high  ( >  -0.6 )  in  a  tain  of  1 2.9  mm/hr.  Contrast  for  the  95  GHz  sensor  was 
acceptable  in  clear  weather  but  declined  mote  at  higher  rain  rates.  SVR  at  35  GHz  was 
acceptably  high  ( >  5)  in  clear,  snow,  and  fog,  but  it  dropped  dramatically  in  rain.  This  would 
indicate  that,  althou^  the  35  GHz  radar  image  became  "noisy"  in  rain,  the  contrast  remained 
acceptable.  SVR  for  the  95  GHz  radar  was  lower,  even  in  clear  weather,  suggesting  that  this 
particular  95  GHz  radar  was  more  "noisy"  than  the  35  GHz  radar.  95  GHz  SVR  also  declined  in 
rain  conditions,  but  less  so  than  the  35  GHz  radar  values.  The  sharpness  values  are  more 
difficult  to  relate  to  senstv  band  and  meteorological  ccmdition,  but  the  95  GHz  radar  had  higher 
sharpness.  The  inconsistencies  in  lepmted  sharpness  suggest  that  the  method  used  to  measure 
sharpness  does  not  provide  a  reliable  performance  criteria. 
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Table  6.  MMW  Performance  Summary  At  2  Km  Range 


Meteorological 

Condition 

Freq 

(GHz) 

Contrast 

SVR 

Sharpness  (deg* 

1) 

Qear  (Baseline) 

35 

high  (-0.98) 

high  (6.9) 

high  (3.3) 

95 

high  (-0.64) 

medium  (1.8) 

medium  (1.78) 

Snow 

35 

high  (-0.99) 

high  (8.6) 

medium  (2.0) 

95 

medium  (-0.67) 

medium  (1.8) 

high  (5.33) 

35 

hi3h(-0.99) 

high  (7.9) 

medium  (2.0) 

95 

medium  (-0.55) 

medium  (1.6) 

high  (3.33) 

Rain  (12  mm/hr) 

35 

high  (-0.81) 

medium  (2.3) 

medium  (1.7) 

95 

low  (-0.33) 

medium  (1.5) 

high  (4.44) 

Rain  (5.3  mm/hr) 

35 

high  (-0.95) 

medium  (3.62) 

medium  (1.8) 

Rain  (8.8  mm/hr) 

95 

low  (-0.23) 

low  (0.7) 

not  measurable 

Rain  (12.9  mm/hr) 

35 

medium  (-0.65) 

low  (1.22) 

medium  (1.7) 

Rain  (20.0  mm/hr) 

95 

low  (-0.03) 

low  (1.08) 

not  measurable 

33.6.  Infrared  Sensor  Test  Data  Matrix 

Baseline  data  were  collected  with  the  Kodak  IR  camera  system  on  two  occasions. 
The  images  were  collected  over  a  24  hour  period  with  nominally  clear  weather  for  both 
collection  periods.  IR  data  in  low  visibility  conditions  were  collected  on  four  separate  dates. 
The  low  visibility  weather  conditions  were  nominally  identified  as  rain  with  accompanying  fog. 
The  visibility  on  those  data  collection  periods  ranged  from  less  than  a  kilometer  to  nearly  28 
kilometers.  Tables  7  and  8  summarize  the  IR  data  collected  and  analyzed. 
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Data  CoUected  At  WPAFB  03/13/92  Through  0S/2S/92 


Number  Images 
Analyzed 

Number  with 
Runway  Measurable 

Baseline  Diurnal 

(03/13/92) 

41 

41 

Fbg/Rain 

(03/18/92) 

9 

9 

Fog/Rain 

(03/30/92) 

16 

7 

Fbg/Rain 

(04/18/92) 

6 

6 

Fog/Rain 

(04/21/92) 

6 

4 

Baseline  Diurnal 

(05/27/92) 

11 

11 

TOTALS 

89 

78 

Total  Number  of  Runway  Radiance  Measurements  fiom  Images 

235 

3  J.7.  Infrared  Sensor  Baseline  Performance 


The  contrast  available  in  IR  images  collected  during  clear  weather  was  observed  to  mirmr 
the  temporal  variations  in  surface  temperatures  during  the  diurnal  periods  in  which 


measurements  were  made,  except  at  particular  times  of  day  when  the  sun  was  positioned  to 
relflect  fiom  the  runway  surface  into  die  camera  field  oi  view.  The  measured  craitrast  was  low 
during  the  night  and  reached  maximum  levels  in  mid  aftemotxi,  varying  in  a  mann»  similar  to 
the  behavior  of  measured  surface  tenqierature  differences.  The  solar  reflection  fiom  die  nmway 
generated  a  sharply  peaked  maximum  in  the  late  afternoon,  corresponding  to  the  time  of 
alignment  of  the  sun  with  the  reflected  line  of  sight  from  the  tower.  These  observadrais  prompt 
the  conclusion  that  the  ground  surface  temperature  differences  are  the  primary  influence  on  IR 
image  contrast  collected  in  clear  weadier  with  a  platinum  silicide  (PtSi)  camera  qierating  in  the  3 
to  5  micron  band,  and  that  reflections  of  illumiiuUing  radiation  fiom  the  sun  are  (xily  inqxxtant 
when  the  solar  alignment  is  near  the  specularly  reflected  line  of  sight  The  weather  ccmdidons 
required  to  produce  thermal  reversal  of  the  runway  and  the  grass  badcgtound  did  not  appear  to 
exist  on  the  dates  on  which  baseline  performance  data  was  taken. 

Sharpness  measured  in  cross-runway  profiles  showed  transitions  covering  from  one  to 
three  pixel  placing  with  no  obvious  systematic  effects  related  to  range,  visibility,  time  of  day,  ra: 
other  weather  condition.  The  mean  transition  zone  was  observed  to  be  0.16  degrees  wide. 

3  J.8.  Infrared  Sensor  Performance  in  Fog,  Snow  and  Rain 

Low  visibility  conditions  of  fog,  snow,  and  r^  imposed  significant  reductions  in  runway 
visibility.  It  was  not  possible  to  detect  the  runway  in  IR  image'data  collected  in  rain  or  fog  when 
the  measured  visibility  was  less  than'one  mile. 

The  IR  ccmtrast  is  reduced  in  precipitation  conditions,  {xindpally  because  the  temperature 
differences  are  reduced.  IR  contrast  was  also  affected  to  some  degree  by  attenuation  along  the 
path  timxigh  die  atmosiriiere,  but  the  relative  impcxtance  of  atnx)S[dieric  attenuatitm  was  difBcult 
to  determine  because  of  the  small  temperature  differences  observed. 

The  fog  drop  size  distributions  in  those  cases  where  measurements  were  available  implied 
that  the  "fog"  was  very  light  and  was  composed  of  relatively  small  particles  with  diameters  less 
than  5  microns.  Fog  is  generally  identified  with  droplet  diameters  from  5  to  40  microns.^ 

The  extinction  inferred  fixim  the  measured  visibility  for  the  low  visibiliQ^  conditions  was 
generally  lower  than  for  clear  weather,  but  the  visibility  was  not  always  low  enough  to  indicate 
significant  amounts  of  fog.  The  extinction  calculated  from  rain  and  fog  drop  size  distributions 


^Dennis,  Richard,  Handbook  on  Aerosols.  U.S,  Dept,  of  Energy,  NTIS  #  TID-26608, 
Januaiyl976,  p.3. 
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shows  dutt  the  measured  optical  visibiUty  is  recbioed  primarify  due  to  raindrop  extin^ 

the  extinction  due  to  fog  particles  is  very  small  in  all  of  the  cases  for  which  particle  size  data 

were  available. 

33.^.  Conclusions  Regarding  SVS  Sensor  Tower  Tests 
33.8.1  MMW  Sensors 

All  six  of  the  MMW  sensors  tested  at  the  tower  facility  were  capable  of  imaging  the 
airport  runway  scene  in  clear  weather  conditions.  There  were  significant  differences  in  the 
MMW  imaging  smsors'  angular  resolution,  runway-to-grass  contrast,  signal-to-noise  ratio,  and 
maximum  runway  detection  range.  As  would  be  expected  from  anteima  theory,  the  95  GHz 
radar  sensors  have  more  than  twice  the  angular  resolution  of  the  35  GHz  radars  fca-the  same  30 
inch  antenna  aperture.  The  differences  in  MMW  radar  RCS  between  the  runway  pavement  and 
bordering  grass  areas  at  the  2*  to  3*  incident  angle  are  about  16  to  22  dB.  Resolution  limitaticms 
of  the  MMW  sensors  prevented  them  from  fully  converting  this  RCS  difference  into  image 
contrast  The  94*95  GHz  radar  sensors  tested  lacked  tire  performance  to  image  the  runway  out  to 
the  end  at  3,300  m  range.  The  35  GHz  radars  exhibited  higher  signal-to-noise  ratio,  and  were 
able  to  image  the  runway  to  3,300  m  range. 

Metetwoiogical  effects  of  fog,  snow,  and  tain  decreased  the  maximum  runway  detection 
range  for  the  MMW  sensors  by  varying  degrees.  The  MMW  detection  range  was  not 
significantly  reduced  by  the  snowfall  and  fog  conditions  that  occurred  during  the  tests.  More 
MMW  tower  test  data  ate  needed  in  fogs  of  less  than  one  mile  visibility  to  establish  any 
performance  limitations  due  to  fog.  Rainfall  rates  as  low  as  2  mm/hr  reduced  the  MMW 
detection  ranges,  especially  for  95  GHz.  Runway  detection  by  the  35  GHz  radars  was  seriously 
degraded  for  rainfall  rates  greater  than  20  rrun/hr.  As  was  {xedicted  from  MMW  pr(^>agation 
theory,  the  dominant  effect  of  rain  on  image  quality  at  ranges  of  2  to  4  km  is  signal  attenuation. 
The  35  GHz  radar  sensor  tested  provided  the  best  runway  detection  performance  in  clear  and 
adverse  weather  conditions  with  airport  scene  resolution  adequate  for  the  pilots'  management  of 
flight  path  to  the  runway. 

3333.  Inflrared  Sensors 

The  dependence  of  IR  contrast  on  ground  surface  temperature  differences  implies  the 
dominance  of  the  IR  radiation  emitted  by  the  scene  components  which  is  a  fimction  of  surface 
temperature  and  the  emissivity  of  surface  materials.  Reflection  of  sources  of  illumination  are 
important  only  for  the  solar  disk  and  only  at  times  when  the  sun  is  properly  positioned.  The 
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cyclic  diurnal  behavior  is  derived  from  solar  heating  of  the  ground  which  reaches  its  naaximum 
in  eaiiy  afternoon,  and  which  is  replaced  at  night  by  the  cooling  effects  of  radiation  from  the 
ground  to  the  cold  sky.  Other  observers  have  reported  cases  of  tlM  grass  background  being 
warmer  than  the  concrete  runway  at  some  times  of  day  so  that  the  computed  contrast  is  a 
negative  value.  Thernud  reversal  was  observed  during  measurements  under  low  visibility 
conditions. 

Definitive  conclusions  as  to  IR  sensor  system  performance  in  fog  are  not  possible  due  to 
the  lack  of  cases  of  thick  fog  during  die  period  of  tower  testing  causing  significant  obscuratitMi  of 
the  runway.  The  measured  PtSi  IR  sensor  performance  data  are  consistent,  however,  with  the 
petfoimance  estimates  derived  in  the  sensor  performance  modeling  work  of  this  Program.  There 
is  no  way  to  directly  compare  the  IR  system  quantitatively  with  visible  wavelength  sensors, 
since  conqiarison  data  in  the  visible  band  were  not  collected,  but  the  PtSi  IR  sensor  operating  in 
the  3  to  5  micron  IR  band  showed  no  obvious  improvement  over  the  visible  band  under  the 
cmiditkMis  encountered  during  these  tests.  This  is  in  agreement  with  performance  estimates  based 
on  drop  size  distributions  representative  of  typical  fog  types. 

3.4.  EXPERIMENTAL  SYSTEM  INTEGRATION,  EVALUATION  AND 
DEMONSTRATION  (SIED) 

The  objectives  of  the  SIED  task  were  to  implement,  demonstrate  and  document  the 
csyiabilities  of  an  experimental  synthetic  vision  system  using  existing  technologies  on-board  an 
executive  class  transport  aincraft  MMW  and  FUR  soisot  data  wane  to  be  collected,  along  widi 
measured  weather  data,  aircraft  performarice  data  and  pilot  perfcxmarice  data  for  analyses  and 
documentatiorL  This  was  to  be  acconqilished  under  varying  weather  conditions  and  at  a  variety 
of  airpmts  for  rqrptoach,  landing  and  ground  operations.  Specific  test  objectives  were  idmtified 
as  follows: 

•  En^irically  measure  the  achieved  performance  of  the  integrated  pilot/^thetic  visicn 
system  during  low  visibility  operations. 

•  Assess  the  pilots  capabilities  and  workload  when  using  the  functional  prototype 

synthetic  vision  system. 

•  Determine  the  operational  characteristics  of  the  imaging  sensor  used  in  the  functi(»al 
prototype  synthetic  vision  system  in  terms  of  the  airport  envirorunent  and  actual 

weather  encountered. 

-  hfeasure  the  i^ysical  phenomena  of  millimeter  wavelength  radar  imaging  of  airpcat 
scenes  at  low  visibilities. 
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•  Measure  perfiMnianoe  of  the  millimeter  wavelength  radar  ami  its  image  proc^ 
undn  (^)«ational  conditions. 

-  Measure  petfonnanoe  of  die  forward  kxddng  infra-red  sensor  under  operatioaal 
conditions. 

-  Nfeasure  die  actual  weadierconditkmsdiat  the  aircraft  encounters  when 
measuring  the  above  phenomena  and  sensor  performance. 

•  Determirie,  document,  and  correlate  the  actual  weather  condidtws  existing 
between  the  aircraft  and  the  runway  for  all  approaches  in  actual  weather. 

•  D^ennine  the  image  quality  in  a  manner  diat  can  be  correlated  to  achieved 
performance  and  is  transferable  to  future  synthetic  vision  systems. 

Figure  18  illustrates  the  qietatimial  rqiproach  used  in  making  the  evaluation  measurements 
listed  above.  They  included : 

•  Manually  flown  ptedsions^iixoaches  through  the  end  of  ndl  out  ex’ missed 
approach  point. 

•  Manually  flown  non-precision  approaches  with  a  no-navaid  final  segment 

•  Ground  operations  including  taxi,  roil  out  and  takeoff. 
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EXPERIMENTAL  SYNTHETIC  VISION  SYSTEM 


Figure  18.  Flight  Test  Methodology 
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Mi^or  Nfikstones.  The  following  major  milestones  were  established  and  accomplished 
during  the  System  Integration.  Evaluation  and  Demonstration  task: 


1  Program  Milestones  | 

Date 

Task  Accompltshment  Plan 

Head-up  Di^lay  Selection 

Radome  Specification 

Experimental  SVS  Requirements 
Stu^ 

Sitnulatkm  Requirnnents 

^xil  1991 

April  1991 

May  1991 

June  1991 

June  1991 

Aircraft  Selection 

July  1991 

Preliminary  Design  Review 

July  1991 

Critical  Design  Review 

Nov/Dec  1991 

RogramPlan 

Fdxuary  1992 

35  GHz.  Radome  Available 

Fdxuaty  1992 

Hot  Bench  Integration  and  Test 

Fdxuary  1992 

Fli^  Test  Plan 

March  1992 

Safety  Plan 

March  1992 

FAA  Experimental  Certificate 

March  1992 

Flight  Readiness  Review  No.  1 

April  1992 

Suitability  Flights  (35  GHz.) 

May  1992 

Evaluation  Flights  (35  GHz.) 

July  1992 

Flight  Readiness  Review  No.  2 

August  1992 

FAA  Waiver  To  CAT  nia 

August  1992 

Suitability  Flights  (94  GHz,) 

October  1992 

Qmtinue  Eval.  Flights  (35  GHz.) 

November  1992 

Final  QST  conferrace  Meeting 

January  1993 

FnialRqxxt 

F^mtary  1993 

3A1.  Description  Of  Experimental  System 

The  experimental  Synthetic  Vision  System  consisted  of  1)  MMW  and  FLJR  Sensors,  2) 
Head  Up  Display,  3)  Weather  Acquisition  Sensors,  4)  Aircraft,  and  S)  Data  Acquisiticm  System. 
The  experimental  system  incorporated  all  the  functions  in  prototype  form  necessary  to  siqyport 
the  variety  of  operational  approach  and  landing  procedures  to  be  demonstrated  and  evaluated. 

The  system  was  often  referred  to  as  the  Functional  Prototype  Synthetic  Vision  System  (FPS  VS) 
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3A1.1.  SCOMTS 

The  ejqMrimental  system  used  thiee  sensors;  the  Honeywell  35  GHz  MMW  Sensor,  the 
Lear  94  GHz  MMW  Sensor,  and  the  Kodak  3-S  micron  FUR.  These  sensors  provided  an 
opportunity  to  examine  a  wide  range  of  sensor  technology. 

34.1.1.1.  Primary  MMW  Sensor 

Described  briefly  eaiiier  in  this  Executive  Summary,  in  the  overview  of  sensor  tower 
testing,  the  35  GHz  sensor  system  was  developed  for  this  SVS  Technology  Demonstration 
Ptr^ram  by  the  Honeywell  System  Research  Cento'  using  an  existing  receiver  Aransmitter  unit 
devel<^)ed  several  years  earlier  for  anotheriq)plication.  An  electro-mechanical  scanning  antenna 
was  developed  specifically  for  the  SVS  application  by  Malibu  Research  Associates  under 
contract  to  Honeywell.  An  illustration  of  the  installation  of  this  sensor  in  the  ladome  of  the  flight 
test  aircraft  is  provided  in  Figure  19. 

A  shaped  reflector  was  used  to  achieve  a  vertical  fan-beam  pattern  of  approximately  26 
degrees  with  cosecant  squared  rolloff,  and  an  azinuithal  beamwidth  of  0.7  degrees.  Based  on  an 
"Eagle  Scanner"  technique,  a  dielectric  slug  was  used  to  change  the  phase  velocity  of  the 
wav^uide  feed,  scanning  30  degrees  in  the  hcnizontal  plane  at  approximately  10  Hz.  Animage 
processor  performed  the  trigonom^ric  conversirm  from  ran^azimuth  to  elevation-azimuth  to 
produce  the  conformal  image.  Conformality  was  also  maintained  during  platform  motion. 
Platform  altitude,  pitch,  and  toll  information  were  required  by  the  processor  to  perfrmn  the 
conversion  and  stabilization. 


53 


3S  QHz  Maw  Sensor  Arrangement 


Hgiirel9.  35  GHz  Soisor  InstaUatkm  in  Test  Aircraft 
3A1.1^  Backup  MMW  Sensor 

The  Lear  Astronics  94  GHz  MMW  sensor  system  was  built  specifically  for  the  SVS 
Technology  Demonstration  Program.  Because  of  delays  in  its  development  and  acceptance 
testing  resulting  in  late  availability  to  the  SIED  effoit,  this  sensor  became  the  backup  to  the  35 
GHz  sensor  system.  An  illustration  of  the  installation  of  this  sensor  in  the  test  aircraft  is 
provided  in  Hgure  20. 

The  Lear  Astronics  sensor  produced  a  conformal  "C-scope"  image  based  on  reflected  94 
GHzpower.  Range  data  was  obtained  by  using  the  chirped  fiequency.  The  srasor  used  a  narrow 
vertical  fan  beam  antenna  in  which  range  data  was  drained  for  a  given  horizontal  position.  The 
fan  beam  was  mechanically  swept  horizontally  to  fill  in  the  remaining  azimuth  locations. 
Designed  and  constructed  for  Lear  Astronics  by  Malibu  Research  Associates,  the  antenna 
incocpocated  jnlch  stabilization  enabling  the  antenna  to  maintain  the  correct  pointing  angle  down 
the  glidepath  aimed  at  the  touchdown  point  during  an  established  approach. 
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94  GHz  MMW  Sensor  Arrangement 


Figure  20.  94  GHz  Sensor  Instaliation  in  Test  Aircraft 

An  image  {»ocessor  peifonned  the  trigonometric  (invasion  from  range-azimuth  to  elevation- 
azimuth  to  produce  the  conformal  image.  Conformality  was  also  maintained  during  platform 
motion.  Platfonn  altitude,  pitch,  and  roll  were  required  by  the  processor  to  perform  the 
conversion  and  stabilization. 

3.4.1.13.  3-5  Micron  Forward  Looking  Infrared  (FLIR)  Sensor 

A  Kodak  FLIR  Camera,  model  KIR-310  series  200,  was  used  to  {xoduce  an  IR  image.  This 
sensor  was  also  designed  as  a  part  of  the  conqxritive  design  study  carried  out  sqrarately  from  the 
SIED  Task.  This  design  was  then  built  Kodak  for  another  customer  aixl  for  other  purposes  but 

was  subsequently  provided  by  Kodak  for  use  in  the  SIED  Task.  The  location  of  this  sensta-  in  die 
radome  of  the  test  aircraft  can  be  seen  in  Figures  19  and  20. 
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The  sensor  used  a  platinum  silicide  staring  array,  which  was  sensitive  in  the  1-6  micrc  : 
wavelength  range.  An  internal  bandpass  filter  limited  operation  to  the  3-S  micron  range.  The 
array  had  excellent  resolution.  640  x  486  pixels,  and  very  good  thermal  performance. 

The  FLIR  contained  both  a  manual  mode,  requiring  a  dedicated  human  to  constantly 
optimize  the  settings,  and  an  auto  brightness  and  contrast  mode  for  hands-off  operation.  This 
automatic  feature  was  very  important  when  operating  under  varying  dynamic  conditions, 
ai^xoach,  touchdown  aial  taxL  The  platinum  silicide  d^ectw  provided  12  bits  of  dynamic  range. 
The  auto  brighmess/contrast  histogrammed  the  pixels  in  the  scene  and  set  the  8  bit  RS-170 
(video)  levels  apprc^riately.  The  net  result  was  veiy  good  hands  off  operation  under  a  ^^uiety  of 
conditions. 

3.4.I.2.  Head  Up  Display 

The  GEC  Avionics  HUD  projected  both  stroke  symbology  and  a  raster  image  on  to  a 
combining  glass  placed  between  the  pilot's  eyes  and  the  windsreen.  A  photograph  of  the 
installation  of  the  HUD  in  the  test  aircraft  is  provided  in  Figure  21.  Symbols  wane  i»oduced  by 
amtrolling  the  X-Y  deflection  coils  during  the  fly  back  time  of  the  raster  image.  This  resulted  in 
very  bright  crisp  symbols,  overlaid  upon  "normal"  TV  raster  image.  Symbol  generation  was 
based  upon  data  from  existing  on-board  avionics.  A  computer  received,  interpreted,  and 
generated  text  and  symbols  (i.e..  text  •  airspeed,  ground  speed.  Barometric  Alt,  Radar  Alt,... 
symbols  -  heading  tape,  pitch  ladder,  flight  director,  flare  guidance  cue, ..)  The  HUD  also 
produced  a  RS-170  combined  symbology  image  signal.  This  signal  was  used  to  drive  the  central 
HDD  video  display  and  was  recorded  on  the  data  acquisition  VCR. 

An  illustration  of  the  stroke  symbology  used  on  the  GEC  head-up  display  (HUD)  is  shown 
inFigure22.  The  symbol  layout  was  patterned  after  that  used  on  a  HUD  manufactured!^  Flight 
Dynamics,  Inc.  (FDI)-  That  HUD  is  currently  certified  for  Cat  nia  approaches  in  a  Boeing  727 
aircraft  to  runways  with  Cat  nia  equipment  (3  transmissometers,  a  Type  II ILS,  and  an  ALSF 
{q)proach  lighting  system  with  touchdown  zone  and  centerline  lights).  The  FDI  HUD  has  been 
successfully  used  in  Cat  Qla  conditions  by  Alaska  Airlines  for  several  years.  The  symbology 
layout  was  used  in  this  program  because  it  was  a  known  reference .  The  concept  was  to  start 
from  this  reference  and  add  the  synthetic  vision  im^e,  varying  from  the  established  layout  only 
as  required  for  the  SIED  Task.  The  symbols  in  Figure  22  depart  from  the  certified  symbol  set 
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Figure22.  Head-Up  Display  Symlxrfogy  Used  in  SYS  Test  Aircraft 


based  on  recommendations  from  an  SAE  subcommittee  on  HUD  symbology,  and  on  opinions  of 
engineers  at  GEC. 

The  flight  director  guidance  laws  were  developed  by  Hoh  Aeronautics,  Inc.,  under  contract 
to  TRW.  These  control  laws  were  adequate  to  accomplish  the  approach  task  in  significant  winds 
and  wind  shear  and  provide  flare  guidance  that  was  considered  adequate  by  tlw  pilots.  However, 
the  laws  would  have  to  be  fiither  refined  before  they  could  be  certified  for  flight  in  all  operational 
conditions,  especially  for  the  localizer  and  glideslope  capture  functions. 

3.4.13.  Weather  Sensors 

The  aircraft  was  equipped  with  three  weather  sensors;  two  wing  mounted  probes  and  one 
fuselage  mounted  probe.  The  wing  mounted  pods  could  carry  interchangeable  particle 
measurement  laser  probes.  The  fuselage  probe  measured  liquid  water  content.  The  laser  probes 
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available  covered  a  wide  range  of  particle  sizes  including  those  of  water  droplets  found  in  fog, 
cloud  and  precipitation.  One  configuration  of  the  wing  mounted  laser  probes  can  be  seen  in 
Figure  23.  The  raw  data  was  sent  to  a  computer,  where  it  was  recorded  on  a  digital  u^.  The 
computer  also  interpreted  and  printed  a  real  time  snapshot  of  the  collected  data.  Airspeed, 
temperature,  and  static  and  pitot  pressures  were  also  recorded  for  later  use  in  futher  reduction  and 
analyses  of  the  weather  data. 

3.4.I.4.  SYS  Test  Aircraft 

A  Gulfstream-n  business  class  jet,  tail  number  N6SST,  was  used  as  the  flying  platform.  A 
fdiotograi^  of  the  test  aircraft  in  provided  in  Figure  24  con^lete  with  the  modifications  made  to 
support  the  experimental  SYS  equipment..  The  aircraft  was  flown  in  the  Experimental  category. 

3.4.1.4.1  Part  91  Avionics 

The  aircraft  avionics  complement  of  the  test  aircrafi  is  described  in  Table  9.  The  existing 
avionics  package  provided  the  safety  pilot  (left  seat)  with  standard  part  91  equipment. 

Table  9.  Aircraft  Avionics 

1  Weadier  Radar  System;  one  Honeyweli  WC-6S0  (IS”  antenna) 

2  Electronic  Flight  Instrument  System;  one  Hon^rwell  S  tube  EFIS 

3  Air  Data  Computer  System;  one  Honeywell  AZ>8(X) 

4  Altiinderlridicatocs 

5  Vertical  Speed  Indicators 

6  VHF  Communications  System;  triple  Collins  VHF-20  , 

7  HF  Radio;  two  King  KHF-9S0w/M(^rolaNA-13SSELCAL 

8  VHF  Navigation  System,  two  Collins  VlR-30 

9  Avionics  Power  Switching  j 

10  Inertial  Navigation  System;  two  Litton  LTN-92 

1 1  VLF/Omep;  cme  Universal  UNS-lJr  I 

12  Distance  Measuremoit  Equipment  System;  one  Collins  DME-42  and  one  DME- 
40 

13  Automatic  Direction  Finder  System;  two  Collins  ADF-60A 

14  Flight  Director  System;  two  Honeywell  FZ-SOO 

15  TransptMiders;  two  Collins  TDR-90 

16  Radio  Altimeter  System,  one  Collins  ALT-SS6 

1 7  Cockpit  Voice  Recorder,  Fairchild  A-KX) 

18  Flight  Rione;  Wolfsberg  Flitefone  VI 

19  Angle  of  Attack;  Telettyne  AOA 

20  GPS;  Marconi 
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3.4.1.4^  Special  SYS  Aircraft  Features 


The  aircraft  was  modified  to  accommodate  the  following  features  designed  specifically  for 
the  SYS  Functional  Prototype  System  (FPSYS): 

Special  Antennas  The  MMW  and  FLIR  sensors  required  more  space  than  was  originally 
available.  Several  modifications  had  to  be  performed  to  the  nose  area.  The  ILS  glideslope 
antenna  was  replaced  with  a  conformal  antenna  and  relocated  at  the  bottom  of  the  radome.,  the 
ILS  localizer  antenna  was  relocated  to  the  fuselage,  and  die  existing  15"  Weather  Radar  Antenna 
was  replaced  with  a  smaller  12"  model  and  moved  up.  An  external  YHF  Communications 
antenna  was  added  to  the  rear  bottom  of  the  fuselage.  The  antenna  was  connected  to  a  portable 
hand  held  radio  located 

in  the  cabin  at  die  Test  Directors  Work  Station  The  radio  was  operated  in  the  cabin  by  the  Test 
Engineer.  Antenna  Specifications  can  be  found  in  ^pendix  C  YHF  Communication  Antenna. 

Yoke  Position  Transducers.  Position  transducers  were  added  to  the  test  pilot's  yoke 
(right  scat).  The  transducers  (pitch  and  roll)  was  designed  to  provide  a  resistance  which  was 
linearly  proportional  to  the  yoke  position.  This  position  data  was  recorded  by  the  Data 
Acquisition  System  (DAS). 

Soisor  Selector.  A  left  thumb  switch  was  placed  on  the  right  seat  yoke.  The  push  button 
switch  was  used  by  the  pilot  to  rotate  between  the  MMW  image,  FUR  image,  and  no  image  on 
the  HUD. 

Event  Marker.  A  right  thumb  switch  was  placed  on  the  right  seat  yoke.  The  thumb 
switch  was  used  by  the  pilot  to  record  an  Event  Mark  on  the  Data  Acquisition  System. 

Dual-Circuit  Intercom.  The  existing  aircraft  intercom  and  Public  Address  System  was 
enhanced  with  a  second  cabin  intercom  loop.  The  enhanced  intercom  system  fvovided  each  of 
the  FPSYS  Engineering  crew  (Test  Diiecttv,  Test  Engineo’,  MMW  Sensor  Engineer,  Host/Wx, 
and  Observers  ((^  4))  with  a  headset  and  microphone.  The  intercom  was  based  on  a  "Hot" 
Microphone.  For  safety,  the  installation  was  designed  so  that  the  pilot/cqpilot  was  able  to  address 
the  support  crew  over  the  existing  PA  system.  Three  audio  outputs  were  routed  to  the  DAS  for 
audio  recording. 

Radome  Air  Purge.  Pressurized  dry  cabin  air  was  vented  into  the  radome .  The  cabin  air 
reduced  the  moisture  content  within  the  radome.  The  purpose  of  the  vent  was  to  prevent 
condensation  on  the  FUR  window,  waveguides,  and  the  non-sealed  FPSYS  components.  The 
vent  remained  open  for  altitudes  below  10,000  feet. 

Power  Converters/Inverters  The  aircraft  contained  special  power  generators, 
convertersfinverters,  and  transformer  rectifiers.  Tlte  Power  Supplies  provided  clean  regulated 
power  to  the  FPSYS  equipment. 

Circuit  Breakers  The  FPSYS  Equipment  contain  a  hierarchical  2-level  circuit  breaker 
system.  The  first  level  was  located  in  the  rear  baggage  compartment  of  the  aircraft  This  panel 
contained  individual  circuit  breakers  for  each  rack,  and  each  type  of  power  within  each  rack. 
These  circuit  breakers  were  rated  slightly  above  the  maximum  required  current  The  next  level 
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dicuit  breakeis  vveie  at  die  back  of  each  rack  These  breakers  were  rated  at  a  Mgher  cuneDt  levd 
but  had  a  faster  response  time  (short  circuit  protection). 

External  Ground  Power.  Provisions  were  made  to  use  an  external  AC  power  cart.  The 
ground  cart  provided  3  phase  1  IS  VAC  400  Hz  power  to  the  FPSVS. 

Monitor  Ptdnts.  Electronic  interfaces  to  the  existing  aircraft  avionics  were  installed  and 
coimectorized.  This  permitted  connections  to  be  made  easily  between  the  FPSVS  and  the 
avkmics.  These  connecuus  also  permitted  the  Hot  Bendi  emitter  to  bypass  the  aircraft  avimiics 
and  emulate  all  the  required  signals  for  the  FPSVS. 

Sensor  Mounting  Bracket  A  "Universal”  Mounting  bracket  was  installed  on  the  fcxwaid 
bulkhead  located  within  the  radome  space.  Special  signature  brackets  were  designed  for  the 
Honeywell  Sensor,  Lear  Sensor,  and  Kodak  Sensor.  The  signature  Ixackets  held  each  sensor,  and 
mounted  directly  to  the  universal  bracket. 

HUD  Combiner  Camera.  A  HUD  Combiner  video  camera  was  developed  to  record  the 
HUD  Combiner  image  (as  seen  by  the  pilot).  The  camera  was  located  between  the  combiner 
glass  and  the  pilot's  eye.  As  such  the  camera  was  able  to  see  the  HUD  image  and  the  outside 
world.  This  camera  was  used  to  r^ord  contrast  shifts  (due  to  ambient  light),  runway  edge 
problems  and  image  registration  with  the  outside  world. 

Giareshieid  Camera. A  glareshield  video  camera  was  mounted  to  provide  an  out  the 
window  view  of  the  approaches  and  taxi.  The  color  camera  provided  a  real-time  image  of  the 
approach.  The  image  was  avmlable  to  the  cabin  monitors  and  was  recorded  on  the  VCR. 

Equ^mient  Racks.  Nine  5  foot  high  19"  equipment  racks  were  installed  in  the  aircraft  to 
hold  the  experimental  SVS  equipment  and  data  monitoring  and  acquisition  equipment. 

&ad  Up  Display.  The  HUD  Overhead  Unit  was  mounted  above  the  right  seat  A  second 
tray  was  installed  above  the  left  seat  (transfer  between  the  trays  required  approximately  10 
minutes). 

Ifead  Douii  Display.  A  Head  Down  Display  was  centrally  installed  on  the  cockpit  panel. 
The  display  was  mounted  in  place  of  the  center  tube  of  a  5-tube  Honeywell  EFIS  system. 

Wing  Mounted  Weather  Pods.  The  aircraft  was  required  to  cany  two  weather  probe 
pods  in  a  free  air  stream.  The  two  interchangeable  pods,  provided  by  Particle  Measurement 
Systems,  were  mounted  on  each  wing.  Each  pod  was  held  stable  beneath  the  wing  using 
dedicated  pylons.  These  pylons  were  designed  to  cany  a  single  pod  each  of  approximately  45  lbs 
at  a  maximum  aircraft  speed.  The  pylon  was  designed  to  allow  a  quick  removal  and  installation 
of  the  pod. 
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3.4.1^.  Data  Acquisition  System 


The  Data  Acquisition  System  (DAS)  was  designed  to  record  and  reduce  flight  data  for  die 
evaluatitm  flight  test  The  recorded  information  consisted  of  aircraft  avionics,  video,  internal 
MMW,  and  weadier  paiaineters.  There  were  four  maj<r  airborne  acquisition  cat^ories  and  daee 
major  ground  analysis  categories.  The  reponsibilities  for  each  of  the  four  data  acquisition 
systems  is  outlined  below: 


Location 

Airborne  (Acquisititm) 


Ground  (Reduction/Analysis) 


Purpose 
Systran  Data 
Weadier 

MMW(ftimaiy) 
MMW  (Secondary) 
System  Data 
Weather 
MMW(both) 


RespcMidbility 

TRW 

JID 

Honeywell 

Lear 

TRW 

JID 

GTRI 


3.4  JL  Descriptionof  Primary  Test  Airports 

Adescriptionofthepiimaiy  airports  used  during  the  testing  is  provided  in  Table  10.  With 
the  exception  of  San  Diego,  all  of  the  runways  were  surrounded  by  grass.  In  some  cases,  the 
primary  runway  surface  had  a  different  texture  than  the  sides,  where  the  runway  lights  were 
installed.  For  exari^le,  Los  Angeles  had  a  concrete  runway  with  asphalt  sides.  In  other  cases, 
the  sides  of  the  asphalt  runway  were  also  asphalt,  but  the  surface  was  not  as  weU  maintained  as 
the  runway  itself,  and  had  a  rough  ^pearance. 

3.43.  Ground-Based  Simulation 

A  fixed-base  simulation  of  the  synthetic  visitm  HUD  display  was  developed  by  the  Douglas 
Aircraft  Conqiany  under  contract  to  TRW.  An  existing  MD-1 1  cockpit  and  math  model  was 
used  as  a  starting  point  A  GEC  HUD  was  installed  in  the  cockpit  in  a  configuration  identical  to 
that  of  the  G-D  flight  test  aircraft  This  HUD  was  c^)able  of  providing  superimposed  stroke  and 
raster  information.  The  software  supplied  by  GEC  for  the  HUD  was  identical  to  that  used  in  the 
flight  test  The  raster  display  on  the  HUD  was  capable  of  simulating  a  FUR  scene  and  a  MMW 
scene.  Since  these  were  developed  before  the  flight  testing  it  was  necessary  to  estimate  the  FUR 
and  MMW  sensor  performance  characteristics.  All  the  evaluation  pilots  agreed  that  the  raster 
scene  displayed  during  the  simulation  was  reasonably  representative  of  the  results  obtained 
during  the 
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Table  10.  Description  of  Primary  Test  Airports 
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subsequent  flight  testing.  The  MD>1 1  approach  pitch  attitude  was  found  to  be  considerably 
higherthan  the  G-II.  This  was  conqiensated  for  by  using  a  higher  s^roach  airspeed,  and 
ccmducting  all  iq)i»oaches  in  a  25-knot  headwind. 

The  simulation  included  a  Redifon  camera-model  type  Visual  Flight  Attachment  (VFA). 
The  model  runway  was  10,400  feet  long,  200  feet  wide  and  included  approach  lights,  strobes, 
runway  end  markers,  threshold  bars,  touchdown  zone,  VASI,  edge  lights,  and  centerline  lights. 
This  VFA  system  was  crqtable  of  simulating  varying  runway  visual  range  and  ceilings.  It  was  set 
up  to  perform  approach,  landing  and  takeoff  operatimis  in  Cat  I,  Cat  n.  Cat  Dla,  and  Cat  me 
condititms.  Steady  winds,  wind-shears,  crosswinds,  and  turbulence  were  simulated  to  assist  in 
the  development  and  evaluation  of  the  flight  director  laws  and  to  provide  pilot  training  for  the 
flight  test  prograiiL  The  cockpit  was  configured  like  an  MD-1 1  with  six  across  8x8  inch  fully 
operational  CRT  di^lays.  The  Electronic  Display  formats  were  modeled  after  the  MD-1 1.  The 
MD-1 1  autopilot  was  (^)erational,  and  was  frequently  used  for  demonstration  flights. 

The  objectives  of  the  simulation  were  to: 

•  Evaluate  and  refine  the  HUD  symbology  and  flight  director  guidance  laws 

•  Familiarize  the  evaluation  pilots  with  the  HUD  symbology  and  SVS  procedures.  Also 
develop  SVS  procedures  where  necessary 

•  Provide  familiarization  for  demonstration  pilots 

Some  changes  were  made  to  the  HUD  symbology  as  a  result  of  the  initial  evaluations  by 
the  evaluation  pilots.  The  primary  change  was  in  the  flight  directcar  guidance  laws.  These  wme 
modified  ctmsiderably  from  the  initial  configuration,  and  the  simulation  was  used  extensively  to 
accomplish  the  necessary  fine  tuning.  Even  though  the  laws  were  tuned  for  the  MD-11 
aerodynamics,  they  were  found  to  work  acceptably  well  G-Il  without  modification. 

A  number  of  demonstration  flights  were  made  to  Ioqt  members  of  govemmnit  and  industry. 
In  noost  cases,  the  demonstration  pilots  were  given  a  simulation  sessiem  to  gain  familiarity  with 
the  HUD  symbology. 


3.44.  Tcsl  Plan  tnd  PrkHrities 


The  detailed  test  plan  used  to  guide  the  flight  testing  is  included  in  Volume  4  of  this  repeat 
The  waiver  issued  to  the  project  by  the  FAA  to  permit  descents  to  below  CAT  I  minimums  is 
also  included  in  Volume  4.  The  five  selected  airports  were  Areata,  Santa  Maria,  Vandenberg 
AFB,  Santa  Barbara,  and  Point  Mugu  NAS,  all  in  California.  The  test  aircraft  was  e^ieraled  out 
of  Van  Nuys,  California  within  a  reasonable  flying  time  of  the  five  iqqxoved  airptxts.  A  list  of 
prioritized  test  objectives  firom  the  test  plan  is  given  in  Table  1 1,  along  with  what  was  done  to 
acconq)lish  the  objectives.  The  test  objective  priorities  were  established  by  the  test  team  based 
on  inputs  from  the  Certification  Issues  Study  Team. 


Table  11.  Summary  of  Project  Objectives  and  Accomplishments 


Priority 

Objective 

AccompUshment 

1 

Low  visibility  approaches  to  Cat  ma 
minimums  in  actual  Cat  Ilia  conditions. 

37  af^Moaches  in  actual  Cat  ma  conditions  of  which  12  were  to 
ma  minimums.  Some  approaches  were  not  conducted  to  the  Cat 
ma  DH  because  the  airport  was  not  included  in  the  waiver,  or 
because  the  waiver  had  not  yet  been  issued 

2 

Accomplish  the  above  approaches  in 
different  types  of  fog 

Approaches  were  made  in  coastal  fog  (Areata.  Santa  Maria,  and 
Vandenberg),  in  valley  fog  (Huntington  WV),  and  in  firootal  fog 
(Worcester,  MA). 

3 

Conduct  approaches  in  rain  with  varying 
rain-rates 

Approaches  were  made  to  five  different  airports  in  rain  with  rain- 
nues  varying  frmn  0.50  to  22  min/br. 

4 

Conduct  approaches  to  different  types  of 
airport  surfaces 

Approaches  were  made  to  27  different  airports.  Formal  evaluations 
woe  made  during  approaches  to  17  of  these  airports. 

5 

Conduct  landings  in  simulated  Cat  me 
conditions  (i.e.,  simulated  (VO) 

All  three  evaluation  pilots  successfully  accomplished  three 
simulated  (VO  landings  and  roll-outs.  Simulated  (VDtakeoffi  were 
also  accomplished 

6 

Test  ability  to  identify  runway  incursions 
using  the  I4MW  sensors 

Six  runs  were  made  in  simulated  IMC  conditions  where  runway 
and  taxi  way  incursions  were  staged.  The  evaluation  (Hlot  did  not 
know  in  advance  when  these  incursions  were  to  be  staged 

7 

Test  a  second  MMW  radar  at  94  GHz 

The  Lear  94  GHz  MMW  radar  was  installed,  checked  out,  and  11 
final  suitability  runs  were  made 

8 

Test  an  infrared  sensor  in  actual  weather 

A  Kodak  3-5  micron  FUR  was  installed  and  was  operational  in  all 
actual  weather  runs. 

9 

Conduct  approaches  in  snow  conditions 

Approaches  were  made  to  Pueblo  Colorado  in  falling  snow,  with  1 
to  2  inches  of  wet  snow  on  the  runway,  and  to  Pueblo  and  Cdorado 
Springs  to  a  plowed  runway 

10 

Test  ability  to  conduct  non-precision 
approaches  to  simulated  Cat  Ila  minimums 

Localizer  approaches  and  no-navaid-final-segment  approaches 
were  flown  to  simulated  Cat  lUa  cemditions 
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IMC  conditions  were  simulated  by  inserting  a  cardboard  shield  between  the  HUD  and 
windscreen.  The  shield  was  held  in  place  with  Velcro  tape,  and  was  removed  by  the  Test 
Director  at  the  aiq;»optiate  decision  height  In  the  case  of  simulated  Cat  IDc  (0/0)  landings,  the 
shield  was  not  removed  throughout  the  {4)pfx>ach.  landing,  and  rollout  The  safe^  pilot  typically 
took  over  control  of  the  aircraft  below  60  knots  as  he  had  control  of  the  nosewheel  steering.  For 
some  runs,  the  shield  was  removed  at  SO  feet  altitude  to  simulate  Cat  ma,  and  was  reinserted 
during  the  rollout  to  simulate  a  surprise  fog  bank  encounter. 

3.4,5.  Evaluation  Pilots 

Three  evaluation  pilots  participated  in  the  flight  test  program  for  purposes  of  taking  data. 
The  pilots  were  carefully  selected  so  as  to  bring  to  the  tests  a  cross  section  of  experience 
including  extensive  airline  experience,  military  transport,  fighter,  and  helicopter  experience, 
FAA  certification  experience,  and  [xofessional  flight  test  backgrounds  that  included  use  of  head- 
up  displays.  All  three  of  the  pilots  were  type  rated  in  a  number  of  transport  category  aircraft 
Two  of  the  pilots  were  Douglas  Aircraft  Company  experimental  flight  test  pilots  and  participated 
as  part  of  their  employment  by  Douglas;  a  third  pilot  was  an  FAA  experimental  flight  test  pilot 
and  certification  pilot  who  participated  as  part  of  his  responsibilities  to  the  FAA  Transport 
Aircraft  Unification  Directorate. 

Training  fix'  the  evaluations  in  the  G-II  aircraft  was  accon^lished  in  two  phases.  First,  all 
of  the  evaluation  pilots  attended  simulation  and  ground  training  to  qualify  as  second-in- 
command  in  the  G-II  aircraft  at  Simuflight  in  Dallas  Texas.  Sectxid,  a  fixed-base  simulaux  was 
modified  by  Douglas  Aircraft  to  include  the  GHI!  HUD  used  for  the  SVS  program.  Models  of 
the  millimeter-wave  radar  and  forward  looking  infiared  sensors  were  included  in  the  simulaticm, 
and  were  superimposed  on  the  stroke  symbology  on  the  HUD.  The  simulation  was  used  to 
optimize  the  HUD  symbology,  refine  the  flight  director  control  laws,  and  to  accomplish  pilot 
training. 
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3.4.6.  SVS  Instruinent  Approach  Procedures 

For  the  most  part,  the  instrument  approach  procedures  used  in  the  flight  tests  were 
ccxiventional.  Specializedi»oceduies  were  en^loyed  to  ensure  safety,  and  to  obtain  data.  The 
evaluation  pilot  was  requited  to  make  three  callouts  unique  to  the  SVS  ptogranL 

•  Radarlmage-  This  callout  indicated  that  the  pilot  could  see  a  pattern  on  the  HUD  that 
signified  that  the  radar  was  imaging  the  ground 

•  Runway  Image  -  This  was  a  highly  significant  call.  It  indicated  that  the  evaluation 
pilot  had  an  image  of  the  landing  runway,  and  that  the  quality  of  the  image  was 
sufficiently  good  to  continue  below  Cat  I  minimums  on  a  Type  1  beam,  with  no 
transmtssmnetets  (RVR  data),  and  no  touchdown  zone  or  centerline  lights.  The  safety 
pilot  was  required  to  execute  a  missed-tqjproach  if  he  did  not  hear  the  “runway  image” 
call  before  reaching  the  published  decision-height  for  the  approach. 

•  Visual-Land  -  This  was  also  a  highly  significant  call  in  that  it  indicated  that  the  pilot 
had  a  view  of  the  runway  environment  that  was  sufficient  to  continue  to  landing 
without  synthetic  vision.  The  safety  pilot  was  required  to  execute  a  missed  ^){»oach  if 
he  did  not  hear  the  “visual  land”  call  above  the  SVS  DH  for  the  five  airptxts  oa  the 
waiver,  and  the  published  DH  for  all  other  airports.  The  SVS  DH  was  always  SO  feet 

In  addition  to  the  above  calls,  the  Test  Director  was  required  to  monitor  the  radar  and 
barcMiietric  altimeters  {q)pioaching  the  Cat  I  decision-height  If  the  radar  altimeter  indicated  the 
proper  trends  iftproachingDH,  the  test  diiectcn- called  “altimeters  verified”.  The  safety  pilot  was 
required  to  execute  a  missed  iqtproach  if  he  did  not  hear  this  call  for  rqpproaches  in  weather 
below  Cat  I  minimums.  The  purpose  of  this  [nocethire  was  to  limit  the  exposure  time  over  which 
the  single  radar  altimeter  could  fail  with  significant  consequences.  The  probability  of  such  a 
Mure  was  calculated  to  be  less  than  lO^,  a  value  felt  to  be  adequate  for  the  test  environment  by 
the  flight  safety  review  board. 

Three  types  of  approaches  were  made  during  the  fli^  test  program;  the  normal  ILS,  a  non- 
pecision  localizer  ipproach,  and  a  no-navaid-firud-segment  ipproach.  These  are  illustrated  in 
Figure  24.  For  the  ILS  approaches,  the  evaluation  pilot  tracked  the  flight  director  down  to  the 
Cat  ma  decision-height  of  SO  feet.  The  image  was  primanly  used  to  monitor  the  approach, 
although  it  was  common  for  the  evaluation  pilot  to  use  the  image  for  runway  alignment  when  the 
integrity  of  the  localizer  was  questionable.  For  the  non-pecision  localizer  approach,  the  nmmal 
procedure  was  used  for  the  descent  to  the  minimum  descent  altitude  (MDA).  A  descent  below 
the  MDA  was  initiated  after  the  pilot  made  the  “runway  image”  call.  Lateral  control  was 
identical  to  die  ILS  whereas  longitudinal  flight  path  control  depended  (»i  the  image  and  the  HUD 
symbology.  The  flight  director  guidance  cue  was  in  a  mode  to  provide  only  altitude  hold  or 


69 


votical  speed  hold  for  ixm-i»ecision  approaches,  and  the  raw-data  glideslt^  informadon  was 
not  displayed  on  the  HUD.  The  no-navaid-final-segment  api»oach  was  conducted  in  an  idatdcal 
fEudiion  to  the  localizer  apiaoach  except  that  the  test  director  detuned  the  ILS  localizer  fipequency 
after  hearing  the  pilot  call ‘‘nmway  image”.  This  required  the  evaluation  pilot  to  rely  only  on  the 
HUD  image  and  symbolt^  (without  flight  director  or  ILS  guidance)  fw  guidance .  The  safety 
pilot  always  had  full  ILS  glideslope  and  localizer  information  on  his  displays.  For  most 
simulat»l  IMC  qtptoaches  the  cardboard  shield  was  in  place  in  front  of  the  HUD  down  to  an 
altitude  of  SO  feet  A  few  ILS  tqjfxoaches  were  conducted  to  Cat  nk  ((]A))  minimums,  and  a  few 
were  conducted  to  Cat  n  (100  ft  DH)  minimums. 
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Figure  25.  Approach  Procedures  Used  in  Flight  Test  Program 


70 


3.4.7.  Sensor  Peifonnance  In  Flight 

An  assessment  of  the  peifonnance  of  the  sensors  was  conducted  by  GTRI  as  a  part  of  the 
SEIDTask.  This  assessment  was  performed  primarily  to  establish  a  clear  understanding  of  the 
contributions  of  the  sensors  to  the  image  used  by  the  pilots  and  to  the  overall  system 
performance. 

3.4.7.I.  Radar  Sensor  Performance  Characteristics  Measured  In  Flight 

In  perimming  this  assessment,  GTRI  used  many  of  the  same  techniques  for  characterizing 
the  performance  of  the  sensors  that  were  developed  in  the  tower  test  of  the  sensors.  Also,  in 
many  areas,  the  analyses  of  the  performance  of  the  senses  incorporates  information  gained  in 
the  complementary  studies  performed  in  the  tower  facility. 

Figure  26,  an  illustration  of  radar  phenomenology  used  previously  in  this  report  in  the 
discussion  of  testing  of  the  SVS  sensors  in  the  tower  facility,  is  used  again  to  illustrate  a 
hypothetical  runway  surface  and  the  surrounding  terrain  as  a  radar  might  view  them. 

Figure  27  illustrates  the  radar  signature  expected  for  the  lunway-tomin  scenario.  Theoval 
in  this  figure  contains  seven  cmistant-range  cross-sections  finm  the  return  signal  a  radar  might 
receive  when  viewing  the  airport  scene.  Note  the  left  and  right  transitions  in  the  signals 
conesponding  to  the  boundaries  between  the  higher-anq)litude  terrain  returns  and  Aose  of  lower- 
amplitude  fimn  the  runway.  If  the  seven  constant-range  cross-sections  of  Hguie  27  were  to  be 
averaged(along  each  azimuA  line),  a  composite  waveform  would  be  derived  which  could  be 
analyzed  as  illustrated  in  Figure  28.  Because  of  its  general  shape,  the  plot  of  this  waveform  is 
referred  to  as  a  "gutter"  plot 

Three  parameters  can  be  defined  using  the  gutto*  plot  which  it  was  felt  might  be  useful  in 
characterizing  how  well  the  runway  can  be  distinguished  fiom  the  surrounding  terrain.  Contrast 
is  a  fiincticm  of  the  average  signal  level  received  from  the  runway  relative  to  that  received  finm 
the  surrounding  terrain. 
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Figure  28.  Illustration  of  Simple  Gutter  Plot  with  Basic 
Image  Quality  Metrics  Indicated 
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Intuitively  from  Figure  28,  the  contrast  improves  as  the  terrain  brightness  becomes 
increasingly  larger  than  the  runway  brightness. 

The  notion  of  sharpness  is  also  illustrated  in  Figure  28.  Sharpness  is  defined  as  the  inverse 
of  the  angular  extent  in  azimuth  over  which  the  low-to-high  or  high-to-low  transition  occurs.  If 
these  angular  extents  are  very  small,  then  the  transition  will  be  clear  and  distinct  and  can  be 
identified  easily  by  the  pilot.  And  since  sharpness  is  inversely  proportional  to  the  angular 
transition,  larger  sharpness  values  are  desirable. 

The  final  parameter  illustrated  in  Figure  28  is  variability,  which  is  a  measure  of  the 
standard  deviation  of  the  radar  signal  an^litude.  For  a  waveform  such  as  that  shown  in  Figure 
28,  there  are  three  variability  measures  -  one  for  each  side  of  the  terrain  and  one  for  the  runway. 
Large  variability’s  correspond  to  "noisy"  or  "spiky"  return  signals  which  can  mask  actual  surface 
transitions  or  be  taken  to  falsely  represent  surface  transitions  not  present  in  the  scene. 

This  definition  of  variability  is  closely  related  to  the  term  speckle  noise,  which  is  used  to 
describe  the  random  variations  seen  in  signals  returned  from  nominally  homogeneous  areas, 
such  as  a  section  of  asphalt  pavement,  or  a  patch  of  uniform  grass.  While  large  amounts  of 
speckle  noise  within  an  image  will  certainly  be  distracting  to  the  pilot,  smaller  amounts  should 
be  tolerable,  and  may  even  have  the  desirable  effect  of  giving  the  image  texture  and  facilitating 
depth  perception  by  the  pilot  In  general,  however,  low  speckle  noise  levels  (small  variability’s) 
are  desirable  in  the  radar  data. 

In  order  to  quantify  small  and  large  variability’s,  the  parameter  actually  measured  under 
this  program  was  the  signal-to-variability  ratio.  This  ratio  was  obtained  by  dividing  the  signal 
level  difference  between  the  terrain  and  the  runway  by  the  weighted  average  variability  fix'  the 
terrain  md  runway. 

The  image  quality  metrics  defined  above  were  computed  for  the  data  provided  by  the 
Honeywell  radar  at  two  points  in  the  systems.  Hrst,  the  raw  data  ouq}ut  provided  by  the  radar 
receiver  was  analyzed.  These  data  were  obtained  prirx  to  the  jxocessing  necessary  fix'  presenting 
these  data  to  the  HUD.  The  raw  radar  data  were  not  recorded  continuously,  but  a  discrete  image 
corresponding  to  a  con:q)lete  azimuth  scan  of  the  radar  was  c^)tured  roughly  every  four  seconds 
during  approach  and  roll-out  Each  of  these  discrete  raw  radar  data  images  is  called  a  snrqishot 
The  image  quality  analyses  of  these  snapshots  were  performed  by  GTRI  and  are  described  in  this 
report  ( Section  3.4.8). 

Second,  the  same  image  quality  metrics  were  computed  for  the  RS-170  video  presentation 
of  the  radar  data,  just  prior  to  display  on  the  HUD.  These  video  images  were  presented  in 
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standard  C<scope  fomiat  (elevation  versus  azimuth),  and  the  update  rate  for  these  video  unages 
as  provided  by  the  radar  was  af^MPOximately  10  per  second.  The  analyses  of  these  RS-170  radar 
video  data  are  documented  later  in  this  report  in  section  3.4.8  titled  Image  Quality  Performance. 

One  of  the  objectives  of  the  analyses  performed  of  the  Synthetic  Vision  Program  data  was 
to  ^ly  identical  metrics  to  identical  regions  within  the  raw  radar  data  (snapshots)  and  the  RS- 
170  radar  image  data  available  for  display  on  the  HUD.  The  metrics  coriqxited  6om  the  raw  data 
would  represent  the  potential  for  runway  detection  and  recognition  offered  by  the  radar.  Those 
computed  from  the  processed  RS-170  data  would  indicate  how  well  the  Honeywell  image 
processing  methodology  took  advantage  of  this  potential,  as  well  as  what,  if  any,  degradations 
were  introduced  by  formatting  the  data  for  presentation  on  the  HUD. 

Thus,  the  use  of  identical  image  quality  metrics  for  the  two  processes  was  essential.  The 
three  described  above  -  contrast,  sharpness,  and  signal-to-variabiliQr  ratio  -  were  suitable  fix'  both 
applications  and  were  thus  agreed  upon  at  the  outset  of  the  analysis  efforts. 

The  three  image  quality  parameters  described  above  are  just  some  of  the  radar 
characteristics  which  are  imprxtant  in  the  SV  application.  Table  12  below  lists  these  and  others. 

For  each  characteristic,  the  associated  units  are  indicated,  as  well  as  the  significance  of  the 
characteristic  and  the  source  of  the  measurement  Some  analyses  could  best  be  performed  at  the 
tower,  whereas  others  were  performed  both  at  the  mwer  and  during  the  flight  tests.  In  addition, 
two  of  the  characteristics  were  assessed  only  in  the  flight  tests  and  were  evaluated  based  on 
subjective  pilot  opinion,  rather  than  on  pilot-independent  analysis  of  the  raw  data.  These 
characteristics  are  so  noted  in  Table  12. 

Table  12.  Selected  Radar  Characteristics  Important  for  Synthetic  Vision 


Characteristics 

Units 

Significance 

Assessment  Source 

Contrast 

- 

Runway  Detection  &  ID 

Tower,  Flight 

Sharpness 

degrees- 1 

Runway  Detection  &  ID 

Tower,  Flight 

Variability 

- 

Runway  Detection  &  ID 

Tower,  Flight 

Pt  Scatterer  Range  Response 

- 

Range  Resolution 

Tower 

Pt  Scatterer  Angle  Response 

- 

Azimuth  Resolution 

Tower 

Geometric  Distortion 

- 

Runway  Detection  and  ID 

Subj.  Pilot  Assessment 

Field  of  View 

deg  X  deg 

Sensor  Coverage 

Tower 

Sensor  Update  Rate 

frames/se 

Image  Continuity 

Subj.  Pilot  Assessment 

Radar  Cross  Section* 

dBsm 

Detection  vs.  Range 

Tower,  Flight 

Reflectivity  (o°)* 

dB 

Detection  vs.  Range 

Tower,  Flight 

Volumetric  Reflectivity* 

dBm 

Detection  vs.  Range 

Tower,  Flight 

Path  Attenuation* 

dB/km 

Detection  vs.  Range 

Tower,  Flight 

Note:  *  indicates  measurement  requires  fully  calibrated  data. 
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As  indicated  earlier  in  this  leptnt,  surface  reflectivity  (and  RCS),  volumetric  reflectivity, 
and  atmo^;dieiic  attenuation  are  all  fundamental  phenomenological  parameters.  The  accurate 
measurement  of  these  parameters  requires  that  the  radar  be  fully  calibrated  so  that  absolute 
received  power  levels  are  known.  This  calibration  process  typically  requires  that  a  standard 
radar  reflector  of  known  RCS  be  placed  in  the  scene  so  that  measured  power  levels  can  be 
associated  with  ^)ecific  RCS  values.  Typically,  two  or  nxxe  such  standard  reflectt»s  are  used  to 
improve  the  accuracy  of  the  calibration  process. 

These  four  "calibrated"  parameters  define  the  basic  j^nomenology  that  determines  how 
well  the  radar  can  image  the  aiiprxt  scene  of  interest  However,  for  any  given  approach,  th^r  are 
not  essential  fcnr  quantifying  the  observed  sensor  perfcamance.  The  observed  contrast  sharpness, 
etc.  define  that  performance.  Nonetheless,  the  phenomenological  parameters  help  explain  the 
observed  performance. 

Not  only  are  these  parameters  important  in  explaining  sensor  performance  in  a  given 
scenario,  they  also  are  critical  to  extnqwlation  of  the  observed  performance  in  one  scenario  to 
some  other,  different  scenario.  The  contrast  observable  between  a  concrete  runway  and 
surrounding  grass  can  be  predicted  based  on  the  measured  contrast  for  asphalt  runway 
surrounded  by  grass,  and  knowledge  of  the  respective  reflectivities  of  concrete  and  asphalt. 
Thus,  even  though  they  require  the  extra  step  of  fully  calibrating  the  radar  scene,  these 
parameters  were  measured  under  the  SVSTD  program  because  of  their  importance  for  sensor 
performance  assessment 

3.4.7,2.  Summary  of  Radar  Performance  In  Flight  Tests 

Measured  contrast  in  clear  weather  was  high,  permitting  die  pilot  to  declare  d^ection  of  the 
airptxt  at  a  mean  range  of  1  .S  nm,  with  a  standard  deviation  of  0.26  nm.  These  detecti(»  ranges 
corresponded  to  measured  contrast  values  between  roughly  -0.6  and  -0.8. 
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The  values  of  contrast  measured  during  fog  events  were  generally  as  high  or  higher  than 
those  measured  during  clear  weather.  Fog  particles  are  too  small  to  provide  excessive 
attenuation  of  millimeter  waves  at  the  ranges  in^xxtant  for  these  tests.  The  wetting  action  of  the 
fog  may  also  tend  to  enhance  the  backscatter  from  the  surrounding  terrain  and  thus  inoease  the 
measured  contrast  The  test  pilots  were  able  to  successfully  detect  the  runway  evra  in  v«y  dense 
fogs  characterized  by  zero  visibility  or  zero  ceiling.  Good  contrast  was  observed  in  the  measured 
data  for  heavy  fogs  characterized  by  1/8  nm  optical  visibili^’s  and  vertical  penetrations  less  dian 
100  feet. 

The  specific  effects  of  rain  on  the  available  contrast  are  not  well-understood.  An  attempt 
was  made  to  extrapolate  from  clear-weather  contrast  measurements  with  the  aid  of  the  particle 
size  distributions  measured  in  flight  The  in-flight  drop-size  measurements,  and  the  calculaticm 
of  estimated  attenuations  and  rain  rates  from  them,  permitted  estimates  to  be  made  of  the 
reduction  in  signal  levels  due  to  the  presence  of  this  precipitation.  These  calculatitms  indicate 
poor  contrast  at  a  10  mm/hr  rain  rate  and  almost  no  contrast  at  a  29  mm/hr  rain  rate  for  the 
specific  drop-size  distributions  measured.  Results  fix>m  the  tower  test  indicate  pow  ctmtrast  at  a 
12.9  mm/hr  rain  rate  but  fairly  good  contrasts  at  1.2  mm/hr  and  S.3  mm/hr  rain  rates.  Clearly, 
contrast  tends  to  decrease  with  increasing  rain  rate.  Contrast  is  also  expected  to  be  a  function  of 
the  specific  drc^size  distributions  encountered.  Additional  data  are  needed  to  bettor  understand 
these  relationships. 

Accumulated  snow  was  observed  to  greatly  diminish  the  available  contrast  When  snow  is 
{xesent  on  both  the  runway  and  the  terrain,  this  lowered  contrast  is  due  to  homogenization  of  the 
scene  by  the  roughly  uniform  snow  layer.  Plowing  the  runway  enhanced  the  measured  contrast 
by  lowering  the  backscatter  fiom  the  runway  but  improvement  was  not  sufficient  to  produce  a 
usable  image.  Falling  snow,  as  opposed  to  accumulated  snow,  should  not  degrade  the  scene 
contrast  significantly  unless  the  snow  is  quite  heavy.  These  conclusions  for  snow  are 
preliminary  since  they  are  based  on  a  small  number  of  available  snow  scenes,  for  which 
quantitative  physical  data  characterizing  the  snow  (free  water  content,  etc.)  are  not  available. 

The  analyses  described  above  indicate  that  of  the  three  image  quality  metrics,  contrast  is 
the  most  important  in  predicting  when  the  runway  can  be  recognized  in  the  image.  The 
sharpness  metric  was  difficult  to  accurately  quantify  based  on  the  measurement  technique 
employed.  Measured  sharpness  values  were  typically  about  1  to  S  pixels  but  varied  in  an 
rq>parently  random  fashion  within  this  range  as  a  function  of  distance  to  region  of  interest  There 
were  also  no  clear  trends  in  measured  sharpness  as  a  function  of  weather  conditions. 
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Signal-to-variability  results  were  somewhat  more  consistent  For  slant  ranges  of  about 
ISOO  metus  or  less,  the  measured  SVR  values  for  clear  weather,  fog.  and  snow  were  typically 
greater  than  five.  Fch*  slant  ranges  greater  than  1500  meters  so,  the  SVR  typically  fell  in  the 
range  of  2  to  8.  A  SVR  of  5  indicates  that  the  signal  the  pilot  is  trying  to  detect  (namely,  the 
transitkm  between  die  itinway  pavement  and  the  surrounding  terrain)  is  five  times  larger  dian  die 
background  variability  from  which  this  signal  must  be  extracted. 

The  SVR  values  measured  indicate  that  in  general  for  clear  wead^r,  fog,  and  snow,  the 
signal  to  be  detected  is  significantly  larger  than  the  background  variability  in  the  scene.  These 
relatively  large  SVR  values  lend  insight  into  the  runway  detecdon  i»ocess  that  faces  a  human. 
Namely,  this  process  is  best  viewed  as  acquiring  a  signal  (runway-terrain  transition)  which  has 
grown  large  enough  to  cross  some  detection  threshold,  rather  than  as  a  process  whereby  the 
signal  (transition)  must  be  extracted  over  time  finm  a  highly  variable  background  which  tends  to 
mask  the  desired  signal. 

In  this  view,  detection  of  the  runway  is  largely  determined  by  the  absolute  signal  itself, 
radier  than  the  signal  con^rared  to  the  background  variabiliQr.  And  the  noost  direct  measurement 
of  this  signal  alone  is  contrast.  Thus,  the  reladvely  large  signal-to-variability  rados  tend  to 
reinforce  the  importance  of  contrast  in  runway  detecdon. 

There  is  also  considerable  evidence  supporting  the  importarxx  of  contrast  Throughout  the 
flight  test  program,  contrast  was  found  to  correlate  well  with  the  subjective  image  quality 
perceived  by  the  pilot  as  well  as  by  the  radar  analyst  In  general,  the  measured  contrast  fell 
between  -0.6  and  -0.8  when  irudal  detecdon  of  the  runway  was  reported  by  the  pilot  in  clear 
weather.  Thus,  the  contrast  at  pilot  detection  was  fairly  consistent. 


3.4A  Image  Quality  Perfomuuice 

During  each  approach,  the  pilot  was  instructed  to  give  a  verbal  callout  when  he  could 
confirm  that  the  runway  image  had  been  identified.  Using  the  time  of  those  callouts,  the  image 
quality  was  examined  to  determine  if  metrics  commonly  used  in  other  imaging  applications 
correlated  to  the  detection  of  airport  features  in  the  MMW  raster  images. 

It  was  planned  that  this  work  would  be  done  using  a  through-the-HUD  video  camera, 
permitting  the  analyst  to  use  the  same  scene  used  by  the  pilot.  When  the  through-the-HUD 
camera  c^>ability  was  not  achieved  with  sufficient  quality  in  time  to  support  image  analyses,  a 
secondary  apixoach  using  the  recorded  sensor  video  ouq>ut  was  used.  This  video  output  does 
not  reflect  the  settings  cf  the  HUD  raster  brightness  and  contrast  controls,  nor  does  it  suffer 
degradauon  from  the  outside  scene  brightness  .  However,  since  the  pilots  used  a  repetitive 
technique  in  adjusting  the  HUD  controls,  it  was  felt  that  the  metrics  would  reflect  a  relatively 
constant  difference  between  the  measured  values  and  those  actually  seen  by  the  pilots. 

The  digitized  image  used  fix  the  analysis  was  made  up  of 480  horizontal  image  scan  lines, 
each  of  which  could  have  640  pixels  or  dots  of  varying  brightness  along  its  length.  Actual 
images  from  the  sensors  often  did  not  incorporate  all  of  these  lines  or  pixels,  averaging  463 
image  scan  lines  and  63 1  pixels  per  scan  line.  The  convention  %  locating  a  point  number  (479) 
at  the  bottom  of  the  image  was  to  count  pixels  as  0  on  the  left  and  increasing  to  a  maximum  of 
639  at  the  right  edge.  The  digitized  scene  covers  a  full  30  Hz  field  of  the  interlaced  video.  The 
field  is  made  up  of  two  separate  60  Hz  frames  which  are  offset  by  one  image  scan  line.  Since  the 
imaging  sensors  produce  their  video  data  at  the  frame  rate  (1/60  second),  the  interlacing  causes 
the  two  adjoining  even/odd  scan  lines  to  have  the  same  or  very  close  data  values.  This  accounts 
for  the  characteristic  pairing  of  data  points  seen  in  the  plotted  contrast  data  for  adjacent  even/odd 
image  scan  lines. 

Contrast 

Based  (xi  the  GTRI  work  with  taw  radar  data,  the  contrast  between  the  runway  and  the 
surrounding  terrain  appeared  to  have  the  most  promise  as  a  correlation  factor.  This  analysis  of 
image  quality  is  consistent  with  the  GTRI  analyses  of  raw  radar  data  in  the  formulation  of 
contrast  Zero  implies  no  contrast;  larger  negative  numbers  imply  itKxeasing  crxitrast  with  die 
runway  darker  than  the  surrounding  terrain;  and  larger  positive  numbers  imply  increasing 
contrast  with  the  runway  brighter  than  the  surrounding  terrain. 

The  data  plots  used  for  the  analysis  fxovic.  the  "runway  to  terrain"  contrast  frx  eadi  video 
scan  line  of  the  image  which  passed  through  the  runway.  The  image  counts  scan  lines  from  die 
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tt^  to  Uw  bottom,  so  scan  lines  with  smaller  numbers  rei»esent  the  far  end  of  the  runway  and 
scan  lims  with  larger  numbers  represent  the  near  or  t^roach  end  of  the  runway. 

Figures  28  through  31  show  the  typical  evolution  of  the  runway  scene  during  the  approach. 

•  Figure  28  presents  the  runway-to-ternun  contrast  at  2.5  Km  firom  touchdown.  Notice 
that  contrast  increases  faiily  linearly  from  the  far  end  of  the  runway  to  about  mid-field 
(scan  lines  121  - 135)  and  then  becomes  a  relatively  constant  value  (about  -0.75)  fm:  the 
near  end  of  the  runway  (scan  lines  136-152). 

•  Figure  29  |xesents  the  runway-to-terrain  contrast  for  the  runway  at  the  point  at  which 
the  pilot  identified  the  runway  image. 

•  Figure  30  presents  die  runway-to-teirain  contrast  for  the  same  runway  when  the  aircraft 
is  approximately  2(X)'  above  the  airport's  surface  and  nominally  1.2  km  from  the 
touchdown  zone.  The  constant  contrast  continues  to  be  seen,  the  deviations  are  due 
primarily  to  interference  of  other  objects  such  as  intersecting  taxiways  or  reflective 
objects  along  the  runway. 

•  Figure  31  again  {xesents  the  nmway-to-tetiain  contrast  for  the  same  runway,  but  now 
at  a  point  50'  above  the  threshold  area.  Hie  decreasing  contrast  as  the  near  end  of  the 
runway  is  partially  due  to  the  build  up  of  "blockiness"  in  the  radar's  near  field  view. 

The  effects  of  intersections  and/or  reflecting  items  are  even  more  pronounced. 

The  ccHTellation  of  contrast  with  the  range  from  the  runway  at  which  the  pUot  declared  a 
runway  image  was  accomplished  for  25  r^roaches  covering  much  of  the  weather  experienced 
by  the  SVSTD/SIED  flight  test  and  representative  airports  and  terrain  features. 

The  results  are  surrunarized  in  Table  13.  Note  that  thne  are  two  columns  fw  contrast*  one 
labeled  Average  and  the  other  Best,  representing  two  ways  of  looking  at  the  runway  data. 

•  Average  Contrast  is  the  average  over  all  of  the  scan  lines  going  through  the  runway 
(i.e.,  all  of  those  shown  on  the  plot). 

•  Best  Contrast  assumes  that  the  pilot  only  needs  a  few  vertically  aligned  pixels  to 
recognize  the  edges  of  the  runway,  and  thus  considers  only  the  best  contiguous  scan 
lines  (usually  4  or  more)  for  averaging. 

With  the  common  band  of  recognition  extending  from  -0.2  to  -0.6  contrast,  the  data  reflects 
more  dispersion  and  slightly  lower  values  than  was  seen  in  the  contrast  data  taken  at  the  radar 
sensor  output.  The  most  probable  cause  is  in  the  jxxxxssing  of  the  radar  data  fw  presentatimi  to 
the  pilot  on  the  video  display.  Some  of  the  dispersion  may  be  due  to  the  use  of  runway  contrast 
without  a  means  to  include  other  objects  which  aid  in  pattern  recognition.  Primary  among  these 
are  the  distinct  and  rqxsatable  patterns  created  by  runways,  taxiways  and  parking  areas  as  well  as 
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by  reflectors  in  the  scene  such  as  light  bars,  runway  arresting  wires,  VASl  installations,  and 
structures  near  the  lunwi^.  Aseoondaiy  aid  to  rBcognitk»  may  have  been  rq>e^d)le  patterns  in 
die  ground  terrain  r^ums  just  priw  to  reaching  ninway  recognition  p(^  These  usually  include 
roads,  fences,  and  other  cultural  features. 

3,4A2.  Variability  And  Sharpness 

Variability  and  sharpness  were  considered  as  possible  metrics  for  image  recognition. 
However,  analysis  of  variability  and  of  sharpness  in  the  video  data  was  not  done  v^dien  the  GTRI 
studies  showed  that  they  had  a  very  low  correlation  in  the  raw  radar  data  which  form  the  video 
data. 


82 


Figure  29.  RS>170  Video  Contrast  •  August  18, 1992-2B  (NTD  at  IS  km) 


Figure  30 .  RS 170  Video  Contrast  -  August  18, 1992-2B  (NTD  at  POot  Confirms  Rwy) 


FlguK  31.  RS 170  Video  Contrast  •  August  18,  1992-2B  (NTD  at  200  ft  AGL) 


Figure  32.  RS  170  Video  Contrast  •  August  18, 1992-2B  (NTD  at  SO  ft  AGL) 


Table  13.  Siiminary  of  Contrast  Metrk  Correlation  to  Runway  Detecticm 


PILOT  CONFIRMS  RUNWAY 
CONTRAST  METRIC  CORRELAHON 


Figure 

Airport 

Flight 

Weather 

Number 

ID 

4 

NTD 

08/18/92-28 

-056 

-039 

VMC 

5 

NTD 

08/18/92.2C 

-0.59 

-0.75 

VMC 

6 

NTD 

08/18/92-2D 

-0.50 

-035 

VMC 

NTD 

08/18/92.2E 

-0J6 

-a44 

VMC 

NTD 

08/18/92-2F 

-0.51 

-032 

VMC 

9 

ACV 

08/28/92.1A 

-0.24 

-037 

W0Xl/8Fog 

10 

ACV 

08/28/92-18 

-0.40 

-a45 

W0Xl/8Fog 

11 

ACV 

08/28/92-lC 

-039 

-030 

WO  X 1/8  Fog 

12 

ACV 

08/28/92-lD 

-034 

-034 

W0Xl/8Fog 

13 

ACV 

08/28/92-lE 

-035 

-0.48 

W0Xl/8Fog 

14 

ACV 

08/28/92-lF 

-0.42 

-0.45 

W0Xl/8Fog 

15 

ACV 

08/28/92-lG 

-037 

-037 

W 1X3/8  Fog 

16 

ACV 

08/28/92-lH 

-0.40 

-030 

WlX3/8Fog 

■91 

LFI 

-0.43 

-030 

6  SCr  M9  BKN  12  O  VC,  1 1/2  L-F 

LFI 

-031 

-035 

VMC 

19 

NHK 

09/25/92-lD 

-033 

-036 

-X  3  SCr  M7  BKN  10  O  VC,  2  R-F 

20 

NHK 

09/27/92-lC 

-037 

-038 

VMC 

21 

MIV 

09/25/92-lE 

+034 

-032 

M5BKN10OVC2R-F 

22 

MIV 

09/27/92-18 

-0.49 

-030 

VMC 

23 

ACY 

09/25/92-11 

-0.18 

-033 

M5BKN12  0VC2R-F 

24 

ACY 

09/27/92-lA 

-039 

-037 

VMC 

25 

ORH 

09/26/92-2A 

-032 

W IX,  1/4  L-F 

26 

ORH 

09/26/92-28 

-037 

W1X,1/4L-F 

27 

ORH 

-037 

W1X,1/4L-F 

28 

HTS 

-031 

-037 

-X  1/16  For 

Average  Values: 

Standard  Deviation: 

H39 

IBl 

3.4^.  Pllot/System  Performance 

The  performance  of  the  expeiimental  Synthetic  Vision  System  and  of  the  pilots  in  using  it 
is  repotted  in  the  form  of  aircraft  trajectory  and  attitude  states,  and  the  subjective  opinions  of  the 
pilots  who  used  it  These  data  reflect  the  ability  of  the  pilots  to  inteiprtt  and  use  several  sources 
of  information  including,  1)  the  image  provided  by  the  SVS  sensor,  2)  the  flight  guidance  cue, 
and  3)  the  HUD  symbology. 

The  image  provided  on  the  HUD  was  used  by  the  pilots  as  the  primary  source  of 
information  upon  which  to  base  the  decision  to  go  below  Cat  I  minimums  on  Type  I ILS 
guidance.  The  "rimway-image"  call  made  by  the  evaluation  pilot  was  highly  significant  because 
it  indicated  that  he  had  an  image  of  the  landing  runway  that  was  sufficiently  good  to  continue 
below  Cat  I  minimums,  on  a  Type  1  beam,  with  no  transmissometers  (RVR  data),  and  no 
touchdown  zone  or  centerline  lights.  The  altituue  and  range  at  which  the  pilot  called  "runway 
image"  is  an  im|xxtant  measure  of  sensex' and  system  perfrxmance.  The  safey  pilot  was  required 
to  execute  a  missed-approach  if  he  did  not  hear  the  "runway  image"  call  before  reaching  the 
published  decision-height  for  approaches  in  actual  Cat  n  or  Cat  nia  conditions.  Pilot 
commentary  indicated  that  pattern  recognition  of  the  runway(s)  and  taxiway(s)  played  an 
important  role  in  the  pilot  decision  to  call  "runway  image". 

The  reported  results  are  confined  to  the  flight  tests  in  which  the  Honeywell  35  GHz  MMW 
radar  sensor  was  used  as  the  source  of  the  HUD  raster  image.  Suitability  tests  with  the  94  GHz 
sensor  indicated  a  substantial  range  limitatitm.  The  reastxis  fw  this  limitation  are  txH  understood 
but  are  believed  to  be  associated  with  the  radome,  the  limited  power  of  the  transmitter  and 
limitations  in  the  processing  of  the  radar  data.  Because  the  runway  image  call  altitude  was 
consistently  below  200  feet  (Cat  I  decision-height),  a  decision  was  made  not  to  conduct  formal 
testing  with  the  Lear  94  GHz  MMW  radar.  Data  obtained  during  suitability  testing  irxiicatedtiiat 
the  average  runway  image  call  altitude  was  168  feet  (standard  deviation  26  feet)  and  the  range 
was  0.50  run  (standard  deviation  .08  nm).  Another  shortcoming  of  the  94  GHz  MMW  was 
substantial  noise  in  the  foreground  at  altitudes  below  100  feet  above  the  runway.  This  noise 
interfned  with  the  pilot's  ability  to  see  the  stroke  symbology  including  the  flight  director.  There 
were  indications  that  the  resolution  of  the  94  GHz  sensor  would  be  quite  good  in  the  absence  of 
the  above  problems. 

The  Kodak  3-5  micron  forward  looking  infrared  (FLIR)  sensor  provided  excellent  image 
quality  in  conditions  without  measurable  moisture.  The  performance  of  the  FI.IR  sensor 
deteriorated  in  conditions  of  measurable  moisture  to  the  point  that  it  did  nst  provide  a  useful 
image.  This  was  determined  early  in  the  program  when  the  FUR  sensor  was  used  as  the  primary 
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sensor  on  altmiadngiQ)proacbes  in  actual  Cat  n  and  Cat  IIIa(x>ndido^^  After  consistent  results 
in  actual  Cat  n  and  Cat  ma  conditions  indicated  the  FUR  sensor  did  not  ptxxiuoe  a  usable  image 
at  the  Cat  I  decisicm  Ireight  (resulting  in  a  missed  approach),  it  was  decided  to  abandon  those 
i^roaches  remaining  in  the  test  matrix  using  that  sensor.  However,  in  all  actual  weather,  the 
FLIR  image  was  monitored  by  the  test  engineer,  and  recorded  on  High-8  video  tape.  Any 
instances  in  which  it  appeared  that  the  FUR  might  jvovide  a  usable  image  were  followed  by  an 
approach  with  the  pilot  using  the  FLIR  image  on  the  HUD.  The  results  were  invariably 
consistent;  the  FUR  sensor  did  not  provide  a  useful  image  in  measurable  moisture. 

3.4.9.1.  Experimental  System  (35  GHz  MMW  Sensor)  Performance  in  Terms  of  Range  and 
Altitude  Where  Pilot  Called  Runway  Imaged 

3.4.9.1.1.  Variation  Between  and  Within  Pilots. 

The  variability  of  the  runway  image  call  between  pilots  and  the  repeatability  of  the  call  for 
each  pilot  are  significant  because  they  ate  measures  of  the  confidence  the  pilots  had  in 
identifying  the  airport  pattern  (taxiways,  runways,  etc.)  and  the  landing  runway.  A  large 
variability  would  indicate  that  the  call  is  highly  subjective,  and  would  be  indicative  of  a  low  level 
of  confidence.  The  average  range  for  the  runway  image  call  was  1 .5  nm  in  clear  air  and  1 .2  nm 
in  fog.  The  average  altitude  above  the  runway  for  the  call  was  5(X)  feet  in  clear  air  and  385  feet 
in  fog.  The  standard  deviation  was  approximately  1/4  nm  in  range  and  1(X)  feet  in  altitude,  both 
in  fog  and  in  clear  air.  These  trends  were  reasonably  consistent  across  all  three  of  the  evaluation 
pilots.  Pilot  commentary  indicated  that  the  runway  image  call  was  made  only  after  it  was 
possible  to  identify  the  landing  nmway  with  a  high  level  of  certainty.  They  also  noted  that  the 
image  tended  to  "pop  into  the  field-of-view"  suddenly  and  with  reasonable  quality  as  0|^X)sed  to 
a  more  gradual  inq)tovement  from  poor  to  good  image  quality.  This  may  explain  why  the  image 
call  ranges  and  altitudes  were  quite  repeatable  with  each  pilot,  and  were  consistent  between 
pilots. 

3.4.9.1.2.  Effect  of  Fog  On  Runway  Image  Call 

The  effect  of  fog  compared  to  clear  air  on  the  range  and  altitude  for  the  runway  image 
call  was  not  operationally  significant.  In  fact,  the  pilots  were  not  aware  that  there  was  a 
measurable  degradation  until  the  data  were  plotted.  It  will  be  noted  that  this  slight  degradation 
on  the  range  of  the  runway  image  call  is  not  consistent  with  the  slight  in^rovement  in  contrast  at 
the  point  of  runway  identification  found  in  the  analysis  of  the  radar  sensor  flight  test 


2  The  range  for  the  runway  image  call  was  defined  as  the  range  from  the  aircraft  to  the  runway 
threshold.  The  call  was  assumed  to  occur  the  instant  that  the  pilot  initiated  the  call. 


87 


perfomiance.  While  further  analysis  is  needed  of  the  data  from  the  tower  sensor  studies,  from 
the  sensor  performance  studies  performed  as  a  part  of  the  flight  tests,  and  from  the  pilot 
performance  studies  to  fully  understand  the  differences  found  in  them  regarding  effects  of  fog  on 
SVS  performance,  the  conclusion  is  clearly  that  the  effect  of  fog  on  the  radar  sensor 
performance  was  negligible. 

3.4.9.13.  Effect  of  Rain  On  Runway  Image  Call 

Increasing  rain-rate  significantly  reduced  foe  range  at  which  the  pilot  called  runway  image. 
The  data  points  at  zero  rain-rate  were  taken  on  dry  runways. 

The  effect  of  rain  on  image  quality  is  complex  due  to  the  variability  of  foe  rain  activity  as 
foe  aircraft  r^iptoaches  foe  runway  (raitHatetrads  to  be  a  function  of  time  and  position).  While 
the  details  are  not  weU  understood,  foe  important  finding  is  that  moderate  rain  had  a  definite 
adverse  effect  on  the  image.  The  use  of  radar  reflectcxs  to  inqxove  the  image  quality  in  moderate 
and  heavy  rain  should  be  studied  as  a  means  to  overcome  this  deficiency. 

It  is  notable  that  in  all  conditions  where  the  rain-rate  was  high  enough  to  degrade  the  radar 
image,  the  visibility  reponed  by  foe  tower  and  foe  runway  visibility  reported  by  the  pilot  were 
well  above  Cat  I  minimums.  This  experimental  finding  should  be  expanded  by  investigating 
statistics  on  visibility  as  a  function  of  rain-rate  and  drop  size  distribution.  If  the  visibility  is  (xrly 
reduced  to  below  Cat  I  minimums  in  v«ty  heavy  rain,  it  could  be  argued  that  there  is  not  a  critical 
need  for  SVS  in  such  conditions.  Additionally,  very  heavy  rain  tends  to  occur  in  short  intervals 
so  that  it  may  be  possible  to  circumvent  the  problem  by  delaying  the  approach  during  the  low- 
probability  short-duration  heavy-rain  events. 

3A9.1.4  Effect  of  Snow  On  Runway  Image  Call 

Four  rq}{xoaches  were  made  to  Pueblo  Colorado  (PUB)  with  light-to-moderate  snow  falling 
This  was  officially  reported  as  light  snow,  but  the  tower  noted  that  it  was  moderate  on  some 
approaches .  There  was  approximately  1  to  2  inches  of  very  wet  snow  (almost  slush)  on  the 
runway  and  surrounding  areas.  The  tower  reported  visibility  was  3/4  miles  in  fog  and  visual 
acquisition  of  the  runway  occurred  at  about  300  f^t  above  the  surface  for  most  approaches. 
Two  evaluation  pilots  each  flew  two  approaches.  Both  pilots  reported  that  there  was  never  a 
usable  runway  image  on  the  HUD.  One  of  foe  pilots  noted  that  the  approach  light  stands 
{xovided  a  good  radar  signature  at  a  range  of  about  1.2  nm.  The  ability  to  see  foe  tqrproach  lights 
before  foe  runway  provides  some  evidence  that  radar  reflectors  may  be  effective  as  a  means  to 
overcome  foe  inability  of  the  MMW  radar  to  image  the  runway  surface  iri  these  conditions. 
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Approaches  weie  made  to  Pueblo  and  Col<»3do  Sfvings  (COS)  the  next  day,  after  the  snow 
had  stopped  Ming.  The  conditions  consisted  of  dan^  runways,  completely  free  of  snow,  and 
with  about  4  to  S  inches  of  wet  snow  <m  the  surrounding  terrain.  There  was  about  a  foot  of  snow 
on  the  sides  of  the  plowed  runways.  The  35  GHz  MMW  did  not  produce  a  usable  image  of  the 
runway  in  these  conditions  at  eidier  COS  w  PUB.  Again,  the  apixoach  light  stands  did  {xovide  a 
good  radar  signature  at  ranges  between  1.2  and  1.5  nnL  The  visibility  on  these  approaches  was  3 
miles  at  PUB  increasing  to  10  miles  at  COS. 


3.4.10.  Subjective  Pilot  Ratings 

Two  subjective  rating  scales  and  a  questionnaire  were  used  to  quantify  pilot  opinion  and 
guide  the  pilot  commentary.  The  two  rating  scales  are  presented  in  Figures  32  and  33.  The 
Modified  Coopn  Harper  (MCH)  scale  was  used  to  obtain  some  insight  into  the  pilot  woricload 
associated  with  use  of  the  synthetic  vision  system  The  Cooper-Harper  scale  was  used  in  the  SVS 
experiments  because  it  also  addresses  pilot  workload,  and  is  considered  reliable  as  a  result  of 
extensive  use  over  the  past  20  years.  Experience  has  shown  that  the  MCH  woricload  ratings 
essentially  always  track  the  Cooper  Harper  handling  qualities  ratings  (HQRs).  That  proved  to  be 
the  case  in  the  SVS  experiments.  For  this  reastxi,  only  the  MCH  workload  ratings  are  presented 
and  discussed  in  this  overview. 

Separate  ratings  were  assigned  for  the  approach,  the  lahding  flare,  and  the  rollout  The 
iq^toach  rating  pertained  only  to  the  pMon  of  die  ^ijxoach  from  200  feet  above  the  runway  to 
the  50  foot  flare  point  All  subjective  pilot  ratings  must  be  referenced  to  some  defined  level  of 
aggressiveness,  hence  performance  standards  must  be  established.  The  performance  standards 
used  in  this  program  are  summarized  in  Table  14. 
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Figure  33.  Cooper  Harper  Handling  Qualities  Rating  (HQR)  Scale 
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Figure  34.  Modified  Cooper  Harper  Workload  Rating  Scale  (MCH) 
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Table  14  Performance  Standards 


Desired  Performance 

Adequate  Performance 

Glideslope  and  localizer 
tracking  above  200  ft. 

AGL. 

±  1  dot 

±2  dot 

Glideslope  and  localizer 
tracking  between  200  and 
50  ft  AGL. 

±  0.50  dots 

±  1  dot 

Airspeed  control  with 
respect  to  target  speed. 

±5  knots 

+ 10  knots 
-  5  knots 

Flare  performance 

Touchdown  between  1000 
and  2000  feet  of  the  runway 
threshold. 

touchdown  at  greater  than 

500  feet  and  less  than  3000 
feet  of  the  runway  threshold. 

Touchdown  within  10  feet  of 
centerline 

Touchdown  on  runway  with 
at  least  5  feet  of  margin  from 
edge. 

Sink  rate  subjectively 
smooth-to-firm 

Sink  rate  subjectively  hard. 

Takeoff  roll 

Maintain  track  within  ±  10 
feet  of  runway  centerline. 

Maintain  aircraft  on  runway 
with  at  least  5  feet  of  margin 
from  edge. 

Achieve  target  climb  attitude 
and  speed  with  little  or  no 
hobbling  or  lateral  directional 
problems. 

Maintain  positive  control  of 
pitch  attitude  and  climb 
speed.  No  safety  pilot 
takeover  necessary. 

Landing  roll 

Maintain  track  within  ±  10 
feet  of  runway  centerline. 

Maintain  aircraft  on  runway 
with  at  least  5  feet  of  margin 
from  edge 

3.4.10.1.  Pilot  Rating  of  Workload  In  Simulated  Cat  nia  and  Cat  me  Conditions 

The  fiequency  distributions  of  the  subjective  workload  ratings  for  tq[^»oaches  and  landing 
flares  to  simulated  Cat  nia  and  Cat  me  conditions  are  shown  in  Hguie  35.  This  data  indicates 
that  the  majcMrity  of  the  ratings  were  3  (ie.,  satisfactory  without  inqnovement).  This  should  not 
be  (xmstrued  to  iiiq)ly  that  die  experimental  S  VS  was  accqitable  as  a  cotified  system,  but  rather 
that  it  was  acceptable  for  specific  approaches  under  the  specified  test  conditions;  in  this  case 
simulated  IMC.  IMC  was  simulated  by  placing  a  cardboard  shield  in  front  of  the  HUD,  and 
removing  tte  shield  at  the  ^ipropriate  time,  e.g.,  50  feet  for  simulated  Cat  ma.  The  cases  rated 
as  4  or  worse  provide  valuable  insight  into  potmdal  ixr^lems  widi  an  operational  SVS  and  w«e 
investigated  to  the  extent  that  resources  permitted. 
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NUMBER  OF  APPROACHES 


Lowest  WwMoad 


WORKLOAD  RATING 


Highest  Woftdoad 


a)  Workload  fUtings  for  Approach  Sagmant  From  an  Attituda  of  250  ft  to  50  ft 


Lowest  Woridoad 


Highest  Workload 


WORKL(MO  RATING 


b)  Workload  Ralinga  for  Plata 

Figure  35.  Frequency  Distribution  of  PUot  Workload  Rating  Data  for  Simulated  CAT  nia 

and  CAT  EQc  Approaches 


93 


3.4.10^  niot  Rating  of  Woricload  in  Actuai  Cat  II  and  Cat  nia  Conditions. 

A  frequency  distribution  of  the  pilot  subjective  woikload  ratings  for  apppoaches  and  landing 
flares  in  conditions  below  Cat  I  minimums  is  shown  in  Figure  36.  Twenty-nine  of  the  tqiptoaches 
received  ratings  of  2  and  3,  two  tqipoaches  were  assigned  a  4,  and  three  apiroaches  were  rated 
10. 

25  T - — - - 


12  3  4  5  6  7  8  9  10 

Lowast  Workload  Highost  Workload 

WORKLOAD  RATING 


a)  Workload  Ratinga  for  Approach  Sagmant  From  an  Altituda  of  250  ft  to  50  ft 


LowaatWoiMoad  Highest  Workload 

WORKLOAD  RATINGS 

b)  Workload  Ratinga  for  Flara 

Figure  36.  Frequenqr  Distribution  of  PUot  Woridoad  Rating  Data  for 
Actual  Cat  n  and  Cat  IHa  Approaches 
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3.4.103  Suimnaiy  Comments  Regarding  Pilot  Performance  and  Woiidoad  Ratings 

All  {^jproaches  inade  in  actual  ix*  simulated  Cat  n  OT  Cat  nia  conditions  were  accq)table  at 
aiipcxts  with  long  ninways  (e.g.,  Pt  Mugu  (NTD)  and  Vandenbeig  (VBG)).  For  tq)pioaches  to 
shorter  runways  (6000  feet  or  less),  issues  such  as  beam  bends,  image  quality,  crosswinds, 
tailwinds,  and  pilot  training  became  significant  (e.g..  Areata  (ACV)  and  Santa  Maria  (SMX)). 
The  woddoad  associated  with  short  runways  tends  to  be  less  severe  if  the  runway  image  is 
available  well  above  the  decision  height  The  ratings  of  10  all  occur  for  cases  whoe  the  runway 
image  call  occurred  below  300  feet  and  less  than  1  nm  from  the  threshold  This  would  indicate 
that  better  MMW  range  is  more  important  for  short  runways  where  the  margin  for  enxx  is  less. 
An  early  runway  image  call  gives  the  pilot  more  time  to  incorporate  the  image  into  his 
instrument  scan  and  control  strategy,  so  that  beam  anomalies  and  crosswinds  are  more  easily 
handled  For  example,  the  problems  encountered  at  ACV  resulted  in  wtxkload  ratings  of  4,  and 
die  runway  image  call  was  made  at  about  500  feet  The  only  odier  rating  wtxse  than  3  (woridoad 
rating  s  4)  was  assigned  at  Carisbad/Palomar  CIA  (CR(^,  which  is  only  4700  feet  long,  and  the 
runway  image  call  was  made  at  490  feet  The  approach  speeds  (135  to  150  knots  depending  on 
weight)  and  handling  characteristics  of  the  G-n  are  similar  to  transport  aircraft  so  that  these 
results  are  directly  applicable  to  that  class  of  aircraft. 

The  flare  and  landing  data  ate  summarized  in  Hguies  34b  and  35b.  Th^  indicate  diat  there 
were  no  significant  {Hoblems  with  that  task  for  Cat  Hand  Cat  ma.  The  pilots  aU  indicated  diat 
the  flare  cue  tm  the  HUD  provided  adequate  guidance.  The  excqition  was  for  the  simulated  Cat 
me  (0/0)  landings  where  the  workload  was  judged  to  be  very  high  by  two  of  the  three  pilots. 
The  flare  cue  used  ftx  this  expaimmtal  system  was  not  (ptimized  to  provide  a  landing  fooqxint 
that  would  insure  high  probability  safe  landings  on  marginally  short  runways,  and  in  varying 
wind  and  wind-shear  conditions.  It  would  be  important  to  optimize  the  flare  cue  for  a 
commercial  system. 

3.4.11.  Summary  <^PQot  Commentary. 

A  summary  of  the  evaluation  pilots'  commentary  related  to  strengths  and  shortcomings  of 
the  experimental  SVS  is  presented  below. 

General  Comments  Related  to  Synthetic  Vision  System  performance 

•  All  of  the  evaluation  pilots  felt  that  the  system  was  viable  as  a  means  to  adiieve  Cat  nia 

minimums  on  1 guidance,  and  to  achieve  lower  minimum  descent  altitudes  cm 
non-precision  approaches. 
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•  All  of  the  evaluadon  pilots  were  enthusiastic  about  the  use  of  a  head-up  display  to  assist 
in  the  transition  from  use  of  the  image  to  use  of  outside  visual  cues. 

Comments  Related  to  the  35  GHz  MMW  Radar  and  FUR 

•  The  FUR  image  was  excellent,  or  it  was  ncm-existent.  Excellent  images  were  observed 
in  conditions  of  haze  cm-  at  the  bottoms  of  clmid  bases.  All  pilots  demonstrated  Cat  me 
(0/0)  landings  using  the  FLIR  image  in  simulated  IMC  conditions  with  workload 
ratings  of  3  or  better.  When  there  was  visible  moisture  (dense  fog  or  rain)  the  FUR  did 
not  produce  a  usable  image. 

•  TbeMMWradarimage  was  usable  to  identify  the  airport  and  the  landing  runway.  The 
pilots  conmented  that  they  relied  heavily  tm  airpert  runway/taxiway  pattern  recognitiem 
to  insure  that  they  did  not  mis-identify  the  runway  as  a  road  or  other  object. 

•  The  pilots  were  able  to  leam  radar  signatures  of  the  terrain  tq^proaching  airports.  For 
example  certain  roads,  fields,  and  towns  showed  up  very  well  on  the  radar.  It  was 
important  to  leam  that  some  objects  produce  a  radar  return  out  of  proportion  to  what 
that  object  produces  in  the  ncninal  visual  field.  Fcx'exaiiq>le  the  radar  return  of  achain- 
link  fence  along  the  side  of  the  runway  or  arresting  cables  across  the  nmway  a  Pt  Mugu 
were  very  bright  The  radar  return  of  sqiproach  light  stands  was  very  bright  and  was 
often  seen  well  before  the  runway  image  (e.g.  Worcester  MA  (ORH)  in  rain  and  fog, 
and  Pueblo  CO  (COS)  in  snow  conditions). 

•  The  image  was  excessively  sensitive  to  the  aircraft  pitch  attitude.  It  was  necessary  to 
conduct  all  {q>{xoaches  with  full  flaps  to  maintain  the  proper  iraminal  pitch  attitude  of 
zero.  In  turbulence  the  necessary  changes  in  pitch  attitude  to  maintain  glideslope 
caused  the  image  to  fade  in  and  out.  It  also  caused  the  raster  brightness  to  vary 
significantly  so  that  it  was  not  possible  to  set  the  proper  value.  Pitch  attitudes  of  greats: 
than  2  degrees  had  a  noticeable  degrading  effect  on  the  image. 

•  The  raster  biighmess  that  was  best  for  the  ^roach,  was  too  bright  after  breakout.  In 
Cat  n  and  Cat  ma  conditions,  breakout  consists  of  a  dim  view  of  the  runway  at  best 
The  edges  of  the  runway  were  obscured  by  die  green  taster  because  the  radar  image  was 
not  peifecdy  aligned  with  the  runway  and/or  die  radar  image  was  mere  narrow  than  the 
runway.  Some  pilots  compromised  by  using  a  less  than  desirable  brightness  on  the 
rqqxoach,  and  others  had  the  Test  Director  turn  off  the  rastH  at  breakout  Onesolutitm 
would  be  to  install  a  "kill  switch"  on  the  column,  but  this  could  be  a  problem  if  the  pilot 
encounters  a  fog  bank  on  the  runway. 

•  The  latency  in  the  image  was  too  large,  and  was  estimated  to  be  rqiproximately  200  ms. 
for  gentle  attitude  changes  and  400  ms.  for  large  angular  rates.  It  was  particularly 
noticeable  in  roll. 

•  The  radar  image  sometimes  "jumped”,  especially  at  low  altitudes.  It  is  suspected  that 
this  is  a  result  of  the  altitude  data  used  as  input  to  the  B-to-C  scope  conversion.  The 
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altitude  signal  consisted  of  pure  barometric  data  above  1000  feet  and  blended  to  pure 
radar  data  at  touchdown.  Significant  variations  in  the  terrain  at  low  altitude  would  result 
in  a  discontinuity  in  the  B-to-C  conversion  process. 

•  There  was  a  tendency  to  get  very  low  on  short  final  when  using  the  flight  path 
symbology  and  MMW  image  to  construct  a  3  degree  glideslope.  This  is  believed  to  be 
a  result  of  mis-registration  of  the  radar  image  with  the  outside  world.  There  is  also 
reason  to  believe  that  the  flight  path  symbology  does  not  provide  sufficiently 
compelling  glideslope  error  data  to  the  pilot  at  altitude  below  200  feet. 

Comments  Related  to  the  Head-Up  Display  Hardware  and  Symbology 

•  The  pilot's  head  must  be  in  a  certain  position  to  properly  view  the  HUD,  called  the 
eyebox.  For  some  pilots,  it  was  necessary  to  make  compromises  to  get  into  this 
position.  For  exan^le,  pilot  LO  could  not  use  the  toe-brakes.  All  of  the  pilots  had  to 
sit  too  low  for  an  optimum  view  over  the  glareshield.  It  is  well  known  that  a  high  seat 
position  is  best  when  making  approaches  to  very  low  minimums. 

•  Some  type  of  auto  brightness  control  is  required  for  the  raster. 

•  The  flight  director  symbol  was  off  the  display  in  large  (about  25  knot)  crosswinds.  The 
flight  director  should  never  leave  the  display,  even  at  the  expense  of  conformality  with 
the  outside  world. 
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3^.  LESSONS  LEARNED. 

Early  in  the  ftwmulation  of  the  SVS  Technology  DenK)nstration,  a  survey  was  perfcnnied  of 
the  status  of  the  technologies  needed  to  demonstrate  the  SVS  concept  and  the  key  issues  were 
identified  that  would  have  to  be  resolved  in  the  course  of  successfully  implementing  the  SVS 
concept  as  an  operational  capability.  As  the  Technology  Demonstration  program  progressed, 
these  issues  began  to  be  thought  of  in  terms  of  operational,  systems  and  technology  issues  with 
a  great  deal  of  overlap  between  these  three  general  categories  of  issues-  Summarized  briefly 
below  are  the  more  significant  lessons  learned  in  the  flight  test  phase  of  the  SVS  Technology 
Demonstration. 

1.  The  quality  of  the  image  produced  by  the  experimental  35  GHz  radar  system  was 
sufficient  to  support  approaches  and  landings  in  Cat  IQa  conditions  on  Type  I ILS 
guidance.  A  majority  of  the  approaches  were  flown  using  ILS  approach  procedures 
and  guidance.  Terrain  imagery  cues  were  verified  on  the  display  early  in  the  approach 
(typically  120()-15(X)  ft  AGL).  At  about  450-550  ft.  AGL  a  runway  image  could  be 
seen  on  the  display  of  sufficient  quality  to  use  as  a  reference  for  flight  path  control.  At 
2(X)  ft  AGL,  the  flight  test  minimums  required  the  presence  of  a  good  raster  image  to 
continue  the  approach.  At  50  ft  AGL  a  vision-obstructing  cardboard  shield  was 
manually  removed,  if  previously  put  up,  to  permit  the  evaluation  pilot  to  transition  to 
outside  references.  The  flare  and  landing  rollout  were  flown  visually  for  most  of  the 
approaches.  Other  than  in  conditions  of  moderate  to  heavy  rain  or  snow  covered 
terrain,  runway  and  adjacent  taxiway  image  quality  were  good  with  lateral,  near,  and  far 
runway  and  taxiway  edges  relatively  well  defined. 

2.  Performance  of  the  35  GHz  system  in  fog  was  excellent,  providing  good  images  in  the 
presence  of  all  advection  or  radiation  fog  in  which  flight  tests  were  conducted  tight 
down  to  zero  ceiling  and  visibility  conditions. 

3.  Performance  of  the  35  GHz  system  in  light  rain  (less  than  6-8  mm  per  hour)  was 
adequate.  In  moderate  (8-10  mm  per  hour)  to  heavy  (22-26mm  per  hour)  rain,  image 
degradation  consisted  of  a  pronounced  reduction  in  maximum  range.  The  existence  of 
pooled  water  on  and  beside  the  runway  coupled  with  heavy  rain  further  reduced  the 
usefulness  of  the  image.  In  all  rain  conditions  encountered,  however,  runway  visibility 
always  exceeded  that  required  for  existing  ILS  minimums. 

4.  Performance  of  the  35  GHz  system  through  falling  snow  was  excellent  In  the  very  few 
snow  conditions  available  during  the  test  period,  however,  snow  cover  of  the  terrain 
surrounding  the  runway  dramatically  reduced  the  range  at  which  a  useful  ima^  could 
be  attained.  Although  the  runway  approach  lights  could  be  clearly  seen  in  the  images 
on  all  approaches,  contrast  between  the  runway  surface  and  surrounding  terrain  was 
nonexistent  until  very  low  (below  200  ft.)  on  the  approaches.  These  effects  were 
apparently  the  same  whether  or  not  the  runway  surface  was  plowed  and  even  in  the 
presence  of  piled  snow  along  the  runway  edges. 
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5.  MMW  sensor  range  is  key  to  the  identification  of  the  aupoit  runway  prior  to  reaching 
the  decision  height  (DH)  or  minimum  decent  altitude  (MDA)/visual  descent  point 
(VDP)  in  an  IMC  ^roach  where  visual  identification  is  normally  required  to  continue 
tlw  approach.  The  synthetic  vision  system  must  provide  a  synthetic  visual  image  of 
sufficient  quality  prior  to  that  point  in  the  ^rproach  to  permit  the  decision  to  be  made 
to  continue  with  the  approach  using  the  sensor  image.  Unlike  today's  instrument 
approach  in  which  the  per-  formance  of  the  human  eye  and  brain  permit  an  almost 
instantaneous  decision  upon  reaching  the  DH  ch*  MDAADP,  the  poorer  resolution  and 
hence  fewer  cues  in  the  SVS  image  will  require  a  greater  period  of  time  for  the  pilot  to 
assimilate  the  needed  in-fixmation  and  make  die  decision.The  experimental  system  35 
GHz  radar  range  was  adequate  for  Type  I ILS  guidance. 

6.  A  requirement  for  image  enhancement  is  highly  dependent  on  the  intended  operational 
use  of  the  SVS  ^stem.  Surprisingly,  system  resolution  was  not  the  limiting  factor  for 
runway  detection  and  identification  or  for  accomplishing  the  approach  to  the  initiation 
of  the  fiare  maneuver.  On  the  other  hand,  the  somewhat  coarse  resolution  of  the  35 
GHz  system  (approximately  0.8  degrees  in  azimuth  and  12-15  meters  in  range),  and  the 
rather  jagged  runway  and  taxi  way  edges  in  tlM  video  display  during  the  latter  phases  of 
the  flare,  landing  rollout  and  taxi  contributed  to  the  very  limited  usefulness  of  the 
experimental  system  to  the  pilots  for  those  operations.  Although  simulated  (cardboard 
shield  up)  zero  visibility  landings  were  made,  pilot  comfort  in  lateral  aircraft  control  in 
the  flare  and  for  taxi  or  rollout  was  degraded  significantly  by  the  lack  of  adequate 
runway  edge  definition  and  by  the  limited  vertical  field  of  view  of  the  image  when  the 
aircraft  was  on  the  ground. 

7.  Antenna  pitch  stabilization  is  necessary  to  keep  the  antenna  elevation  pattern  pointed  at 
the  runway  surface  as  aircraft  pitch  attitudes  vary  during  the  apfxoach  and  for  ground 
operations.  The  usefulness  of  a  runway  radar  image  depends  on  consistency  in  the 
difference  between  radar  energy  forward  scaoer  on  the  runway  and  taxiway  surfaces 
(daik  image  areas)  and  back  scatter  fiom  the  runway  surroundings  (bright  image  areas). 

In  the  Technology  Demonstration  the  antenna  elevation  angle  of  the  35  GHz  radar 
system  could  be  varied  on  the  ground  dirou^  adjustments  inside  the  radome,  Init  could 
not  be  varied  in  flight.  Significant  variations  in  image  quality  were  observed  on 
occasion  with  relatively  small  ( 1  to  2  degree)  changes  in  pitch  attitude  on  approach. 

8.  The  specified  maximum  transport  delay  for  the  experimental  system  image  of  200 
milliseconds  was  exceeded  in  some  circumstances  with  the  35  GHz  sensor  system  by 
an  ^)proximate  factor  of  two,  reaching  an  estimated  400  milliseconds  in  periods  of  high 
roll  rates.  An  image  system  latency  of  about  200  milliseconds  did  appear  to  be  the 
value  beyond  which  pilot  workload  and  pilot  acceptance  rapidly  degraded  when  the 
image  was  used  as  an  element  of  the  primary  guidance  system  with  the  pilot  in  the  loop. 
The  transport  delay  experienced  was  largely  a  function  of  the  limitations  of  the 
processing  used  in  the  experimental  system. 
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9.  In  addition  to  precision  ILS  approaches,  localizer-only  ILS  apfHroaches  and  a  few  no- 
navaid  (for  the  final  segment  of  the  iq)proach)  were  flown  with  the  3S  GHz  system. 
I>jring  the  liinited  tests  performed,  the  vertical  path  was  inanaged  by  the  pilot  primarily 
through  the  combined  use  of  the  raster  image  of  the  runway,  the  HUD  flight  path 
matker  (velocity  vector)  and  the  flight  path  reference  synibols.  It  became  clear  in  these 
tests  that  precise  registration  must  be  achieved  between  the  raster  image,  the  HUD 
symbology  and  the  outside  scene.  Errors  in  registration  of  less  than  1/2  degree 
seriously  affected  the  pilots'  workload  and  vertical  path  management  performance 

10.  Further  development  and  testing  is  required  to  establish  the  minimum  requirements  fcv 
SVS  technology  to  support  detection  and  avoidance  of  runway  and  taxiway  intrusions 
and  to  support  pilot  situation  awareness  on  the  airport  surface.  The  ability  of  the 
experimental  35  GHz  MMW  system  to  provide  runway  intrusion  information  was 
tested  briefly  by  intentionally  placing  a  runway  intruder  (pickup  truck)  at  various 
locations  on  the  runway  and  taxiways  during  approaches  and  a  takeoff  without  the 
pilot's  knowledge  and  with  the  pilot’s  external  vision  restricted  by  a  cardboard  shkld  in 
front  of  the  HUD.  The  pilot  quite  successfully  detected  the  intrusions  in  each  instance 
during  the  approach  and  accomplished  the  missed  approach  in  a  timely  manner.  The 
pilot  did  not  detect  the  intrusion  on  the  takeoff  roll  due  to  the  obscuration  of  the 
obstacle  in  the  image  by  the  HUD  symbology.  The  pilots  were  unable  to  detect  and 
identify  obstacles  in  other  tests  while  on  the  airport  surface  with  the  expoimental  SVS 
because  of  the  limitations  in  resolution,  minimum  range  and  limited  vertical  field  of 
view.  Very  limited  experimeatatitni  with  other  presentation  formats  indicated  that  such 
formats  as  head-down  non-conformal  representations  of  the  runway  image  offer 
promising  solutions  for  runway  roll-out  and  taxi  guidance  as  well  as  obstacle  detection 
and  avoidance. 

1 1 .  Millimeter  wave  approaches  flown  using  the  94  GHz  radar  resulted  in  significantly 
different  image  characteristics  than  the  35  GHz  system.  While  image  resolution  was 
visibly  ingxoved,  image  qualify  was  degraded  by  random  speckle  fiequently  interfoing 
with  image  content  Maximum  ranges  using  the  94  GHz  radar  were  considerably  less 
than  required  fOT  operations  below  CAT  I  minimums;  adequate  runway  images  were 
achieved  at  150  ft  AGL  or  below.  The  significant  factors  thought  to  afiect  the 
perform-ance  of  the  94  GHz  sensor  were  the  limited  transmitter  power,  limitaticHis  in 
processing  of  the  radar  data,  transmissivity  of  the  radome  material  selected,  and 
problems  with  reflections  within  the  radome.  The  limited  performance  of  this  system 
permitted  only  limited  flight  test  and  no  exposure  to  weather  conditions  other  than  dry 
VMC. 

12.  Performance  of  the  Kodak  3-5  micron  infrared  senscM-fystem  was  excellent  in  moderate 
(less  than  80  degrees  Fahrenheit)  temperatures  and  in  the  absence  of  any  measurable 
moisture  in  the  air.  Image  contrast  was  markedly  better  than  visual  contrast  in  haze 
conditions  and  where  the  moisture  was  visible  but  not  measurable.  In  high  (greater 
than  80  degree  Fahrenheit)  temperatures,  image  thermal  blooming  caused  a  general 
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washoin  of  surfEKX  terrain  features  and  re<^Kxdopa:ationa^  In  dry  moderate 

temixrature  conditions  the  perfonnanoe  permitted  simulated  (cardboard  shield  in  place 
to  block  outside  scene)  zero  visibility  landings  and  supported  good  lateral  control 
during  rollout  and  taxi  operations.  No  image  was  obtained  during  any  of  the  fog,  rain 
or  snow  conditions  tested.  Infrared  sensor  approaches  were  flown  in  day  and  night 
conditions,  in  ten^ratures  from  below  freezing  to  above  100  degrees  Fahrenheit,  and 
in  other  weather  conditions  as  specified  fcx*  die  MMW  sensor  using  procedures  identical 
to  those  used  in  testing  the  MMW  sensor. 

13.  The  HUD  itself,  even  without  runway  imagery,  reduced  workload  in  the  approach  and 
landing. 

14.  HUD  conformality  and  image  registration  are  critical  issues.  The  pilot  depends  on 
accurately  registered  image  and  symbology  to  provide  cues  for  flight  path  oxitrol.  The 
methodology  must  be  developed  and  used  in  future  SVS  operations  to  ensure  that 
hardware  and  software  installation  features  provide  the  pilot  a  conformal,  accurately 
registered  image. 

15.  Increased  brightness  of  the  stroke  and  raster  information  displayed  on  the  Head>Up 
Display  is  definitely  needed  in  future  systems.  Inqnoved  control  of  the  relative  bright¬ 
ness  of  the  strdke  and  raster  information  is  needed.  Also,  control  of  the  brightness  of 
the  raster  image  relative  to  the  brightness  of  the  outside  scene  is  definitely  needed  when 
the  outside  scene  rq)pears  during  the  r^pproach.  In  the  Technology  Demonstration,  high 
levels  of  cockpit  ambient  light  sometimes  caused  the  evaluation  pilot  to  be  unable  to 
effectively  see  and  use  the  raster  image  on  the  HUD.  In  some  cases  the  stroke 
symbology  was  also  difficult  to  see  and  use.  To  resolve  the  problem  for  the  purposes  of 
the  flight  test  program,  a  sunshade  wts  used  over  the  windshield  behind  the  HUD 
combiner  glass.  When  in  clouds  the  cocl^it  ambi«it  light  was  much  reduced  and  the 
pilot  could  view  the  HUD  without  the  sunshade  most  of  the  time.  Auto-brightness  fra: 
strcdce  only  was  im-plemented  in  the  HUD  fra:  the  SVS  flight  test  program  and  was  rally 
partially  successful. 

16.  The  flare  control  laws  and  display  were  adequate  to  ensure  a  smooth  and  safe 
touchdown  virtually  every  time,  and  with  minimal  required  training.  Flare  cues  were 
adequate  using  the  display  and  symbology  cues  alone  (brarizon,  airspeed,  radio  altun^ 
height,  flight  director),  in  low  visibility  conditions.  The  flare  cue  consisted  of  a  cross 
that  filled  the  center  of  the  circular  flight  director  symbol,  arid  flashed  at  about  1.5  Hz. 
Flashing  of  the  flare  cue  began  at  about  50  ft.  AGL  during  ILS  approaches,  and 
continued  to  touchdown.  The  flare  cue  did  not,  of  course,  compensate  for  lateral  or 
vertical  beam  bends  in  the  ILS  guidance. 

17.  Ckxiing  the  HUD  symbology  to  armunciate  when  the  display  is  no  longer  conformal  is 
accef^le  but  the  flight  director  should  trever  be  removed  from  the  display.  The  HUD 
field  of  view  (FOV)  was  30  degrees  laterally.  During  SVSTD  approaches  to  landings 
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with  high  crosswinds  (up  to  35  knots  at  90  degrees)  the  velocity  vector  became  a  dotted 
circle  at  the  edge  of  the  display,  and  the  flight  director  vanished  from  the  display. 

18.  HUD  control  laws  were  tailored  for  the  flight  tests  using  a  fixed  base  engineering 
simulator  at  Douglas  Aircraft  Conq)any.  The  ability  to  set  the  gains  in  the  simulator 
and  then  fly  them  in  the  aircraft  the  same  day  was  invaluable  and  undoubtedly  saved 
much  time  in  preparation  for  flight  test. 

19.  There  are  as  many  different  operational  applications  of  SVS  technology  as  there  are 
users.  Each  operational  scenario  will  have  its  unique  functional  requirements  of  the 
technology  and  will  lead  to  variations  in  the  systems  derived  to  satisfy  those  require¬ 
ments.  At  one  end  of  the  spectrum  of  ^plications  of  the  SVS  curability,  and  the  most 
easily  certificated  and  in^)iemented,  will  be  its  use  as  an  independent  monitor  of  other 
components  of  approach  and  landing  guidance  systems.  At  the  other  end  of  the 
spectrum  will  be  iq)plications  in  which  the  pilot's  cognitive  skills  will  be  iiKorporated 
as  an  integral  part  of  the  in^lementation  of  the  SVS  concept  as  a  low  visibility  landing 
system.  While  likely  to  provide  greater  operational  flexibility,  this  ^plication  will 
require  greater  certification  effort  because  criteria  for  its  certification  do  not  presently 
exist.  With  sufficient  development,  SVS  technology  will  substantially  contribute  to 
increased  aircrew  situation  awareness  and  to  the  detection  and  avoidance  of  runway 
intrusions  in  all  im-plementations. 
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4.  CONCLUSIONS 


Potential  applications  of  Synthetic  Vision  System  Technology  are  extensive  and  there 
appear  to  be  no  insurmountable  obstacles  to  its  implementation  from  an  operational  perspective. 
These  applications  promise  dramatic  improvements  to  the  economics  and  safety  of  flight 
operations  in  low  visibility  conditions. 

While  this  Technology  Demonstration  Program  did  not  identify  nor  respond  to  any 
specific  operational  requirement,  a  carefully  selected  set  of  scenarios  and  associated  flight  test 
experiments  were  established  in  conjunction  with  the  Program's  Certification  Issues  Study  Team 
to  ensure  that  a  reasonably  conqjlete  cross  section  of  potential  users'  interests  were  addressed. 

These  operational  scenarios  included  precision  guidance  approach  and  landing  operatitms  down 
to  and  through  Category  Die  operations  on  Type  I  and  Type  n  landing  guidance  systems, 
nonpredsion  £q)proach  and  landing  q)erations,  no-navaid  q)proach  and  landing  operations,  and 
airport  surface  operations  including  low  visibility  takeoff.  While  this  joint  govemment/industiy 
SVS  Program  demonstrated  the  performance  of  existing  technologies  onb'  and  did  not 
investigate  any  aspect  of  the  costs  of  developing  and  implementing  the  SVS  tec^mologies,  the 
Program's  participants  identified  and  investigated  all  technical  and  certification  issues  in 
sufficient  depth  to  conclude  that  there  are  no  insurmountable  operational  or  technical  os 
certification  obstacles  to  implementation  of  the  SVS  capability. 

It  remains  for  potential  users  to  establish  carefully  validated  operational  requirements  for 
low  visibility  operations  from  which  cost  effective  functional  and  system  requirements  can  be 
established. 

The  SVS  Technology  Demonstration  Program  has  caused  the  user  industry,  the 
manufacturing  industry  and  the  regulators  to  become  aware  of  the  potential  of  SVS  technologies 
for  substantial  operational,  economic  and  safety  improvements.  Substantial  research  is  now 
requited  to  establish  adequate  models  of  low  visibility  conditions  and  sensor  phenomenology 
with  which  to  examine  alternative  sensor  technologies,  to  examine  alternative  system  concepts 
with  which  to  satisfy  the  user's  operational  requirements  in  the  most  cost  effective  manno’,  and 
to  establish  Um  relationship  of  SVS  technology  to  other  technologies  such  as  GPS  in  meeting 
those  operational  requirements.  Probably  the  noost  difficult  challenge  to  industry  is  in  performing 
the  necessary  economic  studies  with  sufficient  depth  to  fully  understand  the  true  costs  and 
benefits  of  the  many  technology  options. 
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